Apparatus for transreceiving signals and method for transreceiving signals

Field of the invention

The present invention relates to an apparatus for transreceiving signals and a method for transreceiving signals.

Background art

As the video signal processing speed has become faster, a solution for encoding/decoding ultra high definition (UHD) video is being developed. A solution for processing UHD video as well as HD video without any problem, when receiving the UHD video by using a legacy (or conventional) HD receiver, is being developed. For example in case an aspect ratio of a video that is being transmitted is different from an aspect ratio of a display device of a receiver, each receiver shall be capable of processing the corresponding video at an aspect ratio best-fitting the display device.

However, in case of a related art device decoding is not supported for a compressed video having a 21:9 format, which corresponds to the aspect ratio of a UHD video. In case a video of 21:9 is being transmitted, a receiver having the aspect ratio of 21:9 is required to directly process and display the video of 21:9, and a receiver having the aspect ratio of 16:9 is required to first receive a video stream having the aspect ratio of 21:9 and then output the received video stream in a letterbox format, or required to first receive a cropped video having the aspect ratio of 16:9 and then output a video signal. Additionally, in case subtitles are included in the stream, the receiver having the aspect ratio of 16:9 shall be capable of processing subtitle information.

As described above, since the aspect ratio of a legacy HD receiver or a receiver that can process UHD video can be different, in case the corresponding video is transmitted or received and then processes, a problem may occur. DETAILED DESCRIPTION OF THE INVENTION Technical Objects

An object of the present invention is to provide a method for transreceiving signals and an apparatus for transreceiving signals that can process different videos having different aspect ratios through a receiver having a display device having a different aspect ratio.

Another object of the present invention is to provide a method for transreceiving signals and an apparatus for transreceiving signals that can receive or transmit backward compatible video, which can be processed by receivers being capable of respectively processing a HD video and a UHD video, each having a different aspect ratio.

Another object of the present invention is to provide a method for transreceiving signals and an apparatus for transreceiving signals that can process signaling information, which can differently process different HD videos and UHD videos each having a different aspect ratio in accordance with the specification of each receiver. Technical Solutions

According to an exemplary embodiment, provided herein is a method for transmitting signals, which includes encoding video data; generating signaling information which signals displaying the encoded video data to fit an aspect ratio of a receiver, wherein the signaling information includes aspect ratio control information for displaying high-resolution video data of a first aspect ratio regardless of the aspect ratio of the receiver; and multiplexing the encoded video data and the signaling information and transmitting the multiplexed video data and the signaling information.

The aspect ratio control information may include merging information indicating that the encoded video data are divided and transmitted and merging the divided video data.

The aspect ratio control information may include division information dividing the encoded video data to fit the aspect ratio.

The aspect ratio control information may include position information positioning subtitles of the video to be shifted in accordance with a resolution of the video respective to the encoded video data.

According to another exemplary embodiment, provided herein is an apparatus for transmitting signals, which includes an encoder configured to encode video data; a signaling information generating unit configured to generate signaling information which signals displaying the encoded video data to fit an aspect ratio of a receiver, wherein the signaling information includes aspect ratio control information for displaying high-resolution video data of a first aspect ratio regardless of the aspect ratio of the receiver; and a multiplexer configured to multiplex the encoded video data and the signaling information.

According to yet another exemplary embodiment, provided herein is an apparatus for receiving signals, which includes a demultiplexer configured to demultiplex video streams and signaling information; a signaling information decoding unit configured to decode the demultiplexed signaling information, wherein the signaling information includes aspect ratio control information for displaying high-resolution video data of a first aspect ratio regardless of the aspect ratio of the receiver; and a video decoder configured to decode the demultiplexed video streams in accordance with the decoded signaling information.

According to a further exemplary embodiment, provided herein is a method for receiving signals, which includes demultiplexing video streams and signaling information; decoding the demultiplexed signaling information, wherein the signaling information includes aspect ratio control information for displaying high-resolution video data of a first aspect ratio regardless of the aspect ratio of the receiver; and decoding the demultiplexed video streams in accordance with the decoded signaling information. Effects of the Invention

According to an exemplary embodiment of the present invention, videos having different aspect ratios may be processed through a receiver having a display device having a different aspect ratio.

According to an exemplary embodiment of the present invention, backward compatible video, which can be processed by receivers being capable of respectively processing a HD video and a UHD video, each having a different aspect ratio, may be transmitted or received.

According to an exemplary embodiment of the present invention, HD videos and UHD videos each having a different aspect ratio may be processed differently in accordance with the specification of each receiver.

Brief description of the drawings

FIG. 1 illustrates a method for transmitting signals according to an exemplary embodiment of the present invention.

FIG. 2 illustrates a general view of an example of transmitting a high resolution image to fit aspect ratios of receivers according to an exemplary embodiment of the present invention.

FIG. 3 illustrates a general view of an exemplary stream structure transmitting the high resolution image to fit aspect ratios of receivers according to the exemplary embodiment of the present invention of FIG. 2 .

FIG. 4 illustrates a general view of another example of transmitting a high resolution image to fit aspect ratios of receivers according to an exemplary embodiment of the present invention.

FIG. 5 illustrates a general view of a method for transreceiving signals according to another exemplary embodiment of the present invention.

FIG. 6 illustrates an example of an area where subtitles are being outputted, when transmission is performed as shown in FIG. 5 .

FIG. 7 illustrates an example of displaying a caption window for subtitles in a receiver that can receive UHD video, when transmission is performed as shown in FIG. 5 .

FIG. 8 illustrates an exemplary method for encoding or decoding video data in case of transmitting video data according to a first exemplary embodiment of the present invention.

FIG. 9 illustrates an exemplary method for encoding or decoding video data in case of transmitting video data according to a second exemplary embodiment of the present invention.

FIG. 10 illustrates an example of an encoder encoding high-resolution video data according to a first exemplary embodiment of the present invention.

FIG. 11 illustrates an example of original video, which is separated according to the first exemplary embodiment of the present invention, an exemplary resolution of the separated video and a method for configuring a video.

FIG. 12 illustrates an example of a decoder decoding high-resolution video data according to a first exemplary embodiment of the present invention.

FIG. 13 illustrates an example of merging and filtering cropped videos of the first exemplary embodiment of the present invention.

FIG. 14 illustrates a first example of a receiver according to a second exemplary embodiment of the present invention.

FIG. 15 illustrates exemplary operations of a receiver according to a third exemplary embodiment of the present invention.

FIG. 16 illustrates exemplary signaling information that allows video to be displayed according to the exemplary embodiments of the present invention.

FIG. 17 illustrates detailed syntax values of signaling information according to a first exemplary embodiment of the present invention.

FIG. 18 illustrates an example of a stream level descriptor when following the first exemplary embodiment of the present invention.

FIG. 19 illustrates an exemplary value of information indicating resolution and frame rate of the video given as an example shown above.

FIG. 20 illustrates exemplary information respective to an aspect ratio of the original video. This drawing illustrates information respective to the aspect ratio of an original UHD video corresponding to an original_UHD_video_aspect_ratio field, among the above-described signaling information.

FIG. 21 illustrates exemplary direction information of a cropped video.

FIG. 22 illustrates an exemplary method for configuring a video.

FIG. 23 illustrates an exemplary encoding method in case of encoding sub streams.

FIG. 24 illustrates a stream level descriptor in case of following the first exemplary embodiment of the present invention.

FIG. 25 illustrates exemplary signaling information in case of following the third exemplary embodiment of the present invention.

FIG. 26 illustrates an exemplary field value of an exemplary UHD_video_component_type field.

FIG. 27 illustrates an exemplary field value of an exemplary UHD_video_include_subtitle field.

FIG. 28 illustrates exemplary operations of the receiver, in case a format of a transmission video and a display aspect ratio of the receiver are different.

FIG. 29 illustrates an exemplary case when the exemplary descriptors are included in another signaling information.

FIG. 30 illustrates an exemplary case when the exemplary descriptors are included in another signaling information.

FIG. 31 illustrates an exemplary case when the exemplary descriptors are included in another signaling information.

FIG. 32 illustrates an exemplary syntax of a payload of a SEI section of video data according to the exemplary embodiments of the present invention.

FIG. 33 illustrates an example of a receiving apparatus that can decode and display video data according to at least one exemplary embodiment of the present invention, in case the video data are transmitted according to the exemplary embodiments of the present invention.

FIG. 34 illustrates a method for receiving signals according to an exemplary embodiment of the present invention.

FIG. 35 illustrates an apparatus for transmitting signals according to an exemplary embodiment of the present invention.

FIG. 36 illustrates an apparatus for receiving signals according to an exemplary embodiment of the present invention.

Best mode for carrying out the present invention

Hereinafter, exemplary embodiments of the present invention that can be easily described will be described in detail with reference to the accompanying drawings.

FIG. 1 illustrates a method for transmitting signals according to an exemplary embodiment of the present invention.

Video data are encoded (S 110 ). In case of encoding the video data, according to the exemplary embodiment that will hereinafter be disclosed, encoding information of the video data may be included in the encoded video data.

The encoding information that can be included in the encoded video data will be described in detail in FIG. 32 . The encoded video data may have different structures depending upon the exemplary embodiments that will hereinafter be disclosed, and such exemplary embodiments may vary in accordance with FIGS. 2 and 3 (First embodiment), FIG. 4 (Second embodiment), FIG. 5 to FIG. 7 (Third embodiment).

For example, the encoded video data consists of a structure having high-resolution video divided to fit the conventional (or already-existing) aspect ratio and may include information, which allows the divided video data to be merged back to the high-resolution video. Alternatively, the encoded video data may include information allowing the high-resolution video data to be divided to fit the aspect ratio of the receiver or may also include position information of a letter for positioning subtitle information (e.g., AFD bar).

In case the transmitted signal corresponds to a broadcast signal, signaling information that signals displaying the video data to fit the aspect ratio of the receiver, which is provided separately from the encoded video data, is generated (S 120 ). An example of the signaling information may include diverse information, which are given as examples in FIG. 16 to FIG. 27 and in FIG. 29 to FIG. 31 according to the respective exemplary embodiment, and, herein, the diverse information, which are given as examples in the drawings mentioned above according to the respective exemplary embodiment, may be generated. The signaling information may include signaling information that signals displaying high-resolution video data having a first aspect ratio on the receiver regardless of the aspect ratio. For example, the signaling information that signals displaying high-resolution video data on the receiver regardless of the aspect ratio may include aspect ratio control information of the high-resolution video data. Examples of the signaling information that is provided separately from the video data are given in FIG. 16 to FIG. 27 and FIG. 29 to FIG. 31 .

The encoded video data and the signaling information are multiplexed and the multiplexed video data and signaling information are transmitted (S 130 ).

In case the transmitted data do not correspond to the broadcast signal, generating the signaling information, which is multiplexed with the video data, may be omitted, and video data including aspect ratio control information within the video data section, which is described in step S 110 , are multiplexed with other data (e.g., audio data) and then outputted.

In case the transmitter transmits the video data in accordance with each exemplary embodiment, even in case there are several types of aspect ratios in the receiver display apparatus, or even in case there are several types of performed, the high-resolution video may be displayed in accordance with the aspect ratio of each corresponding display, or the subtitles may be displayed. Additionally, even in case of the legacy receiver, the high-resolution video data may be displayed in accordance with the aspect ratio of the corresponding receiver. More specifically, the receiver may change the high-resolution video data having the first aspect ratio in accordance with the aspect ratio of the receiver by using screen control information and may then be capable of displaying the changed data.

According to the first exemplary embodiment, the aspect ratio control information may include merging information indicating that the encoded video data are transmitted after being divided and merging the divided video data. According to the second exemplary embodiment, the aspect ratio control information may include division information that can divide the encoded video data to best fir the aspect ratio. And, according to the third exemplary embodiment, the aspect ratio control information may include position information for subtitle positioning, which allows subtitle positions of the video to be changed in accordance with the resolution of the video respective to the encoded video data.

FIG. 2 illustrates a general view of an example of transmitting a high resolution image to fit aspect ratios of receivers according to an exemplary embodiment of the present invention. This example shows an exemplary embodiment of servicing an aspect ratio of 16:9 by using a UHD video having an aspect ratio of 21:9.

21:9 UHD source video (Video ( 1 )) is divided to a 16:9 UHD source video (Video ( 2 )) and left/right cropped video (Video ( 3 ) and Video ( 4 )). By performing cropping procedures and so on of the video, a video may be divided into 3 videos.

More specifically, Video ( 1 ) is divided to Video ( 2 )), Video ( 3 ), and Video ( 4 ) and then transmitted.

A receiving apparatus that can display UHD video may receive and display Video ( 2 )), Video ( 3 ), and Video ( 4 ).

Additionally, a receiving apparatus that can display HD video may receive Video ( 2 )) and may convert the UHD video (Video ( 2 ))) of 16:9 to a 16:9 HD video (Video ( 5 )) and may then display the converted video.

FIG. 3 illustrates a general view of an exemplary stream structure transmitting the high resolution image to fit aspect ratios of receivers according to the exemplary embodiment of the present invention of FIG. 2 .

The exemplary stream includes 16:9 UHD video, data being cropped both on the left side and the right side, and supplemental data (UHD composition metadata). The 16:9 UHD video may include HD video having an aspect ratio of 16:9, which can provide the related art HD service, and enhancement data, which correspond to a difference between the 16:9 UHD video and the HD video having the aspect ratio of 16:9.

A legacy HD receiver receives and processes the HD video having the aspect ratio of 16:9, and a 16:9 UHD receiver receives and processes enhancement data for the HD video having the aspect ratio of 16:9 and the UHD video having the aspect ratio of 16:9. Additionally, a 21:9 receiver may configure a 21:9 UHD video by using the UHD video having the aspect ratio of 16:9, the cropped left and right data, and the UHD composition metadata, which correspond to supplemental data. The supplemental data (UHD composition metadata) may include left and right crop (or cropping) coordinates information. Therefore, the receiver may use the supplemental data, so as to generate the UHD video having the aspect ratio of 21:9 by using the UHD video having the aspect ratio of 16:9 and the data being cropped both on the left side and the right side.

Therefore, according to the exemplary embodiment of this drawing, 3 scalable services may be provided.

FIG. 4 illustrates a general view of another example of transmitting a high resolution image to fit aspect ratios of receivers according to an exemplary embodiment of the present invention. In this example, the UHD video having the aspect ratio of 21:9 may be transmitted through a stream that is separate from the HD video having the aspect ratio of 16:9.

Since the HD video of 16:9 is not backward compatible with the UHD video having the aspect ratio of 21:9, the transmitter prepares a UHD video stream, which is separate from the HD video stream. In the UHD video stream, crop coordinates information, which can generate the aspect ratio of a 16:9 video, may be included in supplemental information data (16:9 extraction info metadata) and may then be transmitted.

Therefore, the UHD video receiver receives a UHD video stream having the aspect ratio of 21:9. And, if the UHD video receiver includes a display apparatus having the aspect ratio of 21:9, the UHD video receiver may extract a UHD video from a stream providing the 21:9 UHD service. In this case, the supplemental information data (16:9 extraction info metadata) may be disregarded (or ignored).

Moreover, if the UHD video receiver includes a display apparatus having the aspect ratio of 16:9, the UHD video receiver may extract a video having the aspect ratio of 16:9 from the UHD video stream by using the supplemental information data and may then provide a respective service.

A HD receiver of the related art may provide a HD video by receiving a HD video stream having an aspect ratio of 16:9.

FIG. 5 illustrates a general view of a method for transreceiving signals according to another exemplary embodiment of the present invention.

For example, a video having an aspect ratio of 21:9 is transmitted, yet the video is transmitted as a video having an aspect ratio of 16:9 after scaling the corresponding video format, and yet the corresponding video may be transmitted after including a letterbox area on an upper portion and lower portion within the video having the aspect ratio of 16:9.

FIG. 6 illustrates an exemplary output of a subtitle area, when transmission is performed as shown in FIG. 5 . A legacy HD video receiver displays a caption window for the subtitle area in a display screen section instead of the letterbox section.

FIG. 7 illustrates an example of displaying a caption window for subtitles in a receiver that can receive UHD video, when transmission is performed as shown in FIG. 5 . In case subtitles are included in a stream that transmits UHD video, the already-existing video is outputted starting from an upper left portion (0,0), and the subtitles are displayed on the letterbox area (lower area, surplus area of the display screen) corresponding to outer portions of an actual video areas, so that subtitles can be displayed on an empty portion of the display screen, thereby minimizing interference of the subtitles with the video area and allowing the screen to be used efficiently.

FIG. 8 illustrates an exemplary method for encoding or decoding video data in case of transmitting video data according to a first exemplary embodiment of the present invention.

The transmitter encodes the 16:9 HD video to base layer data, and the transmitter encodes residual data, which configure the 16:9 UHD based upon the data encoded from the base layer data, to enhancement layer 1 data. Additionally, the transmitter encodes the remaining UHD video, which corresponds to 2.5:9 video corresponding to the remaining cropped data respective to the left side and the right side, to enhancement layer 2 data.

The video data being encoded to enhancement layer 2 may be encoded from the overall UHD video having the aspect ratio 21:9 by using correlation and may be encoded as an independent video. Additionally, as described in the first exemplary embodiment, information related to the left/right positions of the data cropped from the left side and the right side may be transmitted.

The information related to the left/right positions of the video data being encoded to enhancement layer 2 may be transmitted by using exemplary embodiments, such as a header within a video stream corresponding to enhancement layer 2 or a descriptor format of section data of a section level. This will be described later on in more detail.

When the receiver receives only the base layer data and decodes the received data, the receiver may display a 16:9 HD video (1920×1080).

When the receiver decodes the base layer data and the enhancement layer 1 data, the receiver may display a 16:9 UHD video (3840×2160).

And, when the receiver decodes all of the base layer data, the enhancement layer 1 data, and the enhancement layer 2 data, the receiver may display a 21:9 UHD video (5040×2160). In this case, the above-described information related to the left/right positions of the video data, which are encoded to enhancement layer 2 , may be used.

Therefore, depending upon the performance or function of the receiver, videos having diverse resolution respective to diverse aspect ratios may be displayed. This example corresponds to an example of transmitting a 4K video by dividing the corresponding 4K video to multiple videos, and videos respective to higher resolution may also be transmitted by using the above-described method.

FIG. 9 illustrates an exemplary method for encoding or decoding video data in case of transmitting video data according to a second exemplary embodiment of the present invention.

If, for example, the transmitter divides (or separates or crops) the 16:9 UHD video from the 4K (5040×2160) UHD video, the transmitter may transmit division (or separation or crop) start information of the 16:9 video along with division (or separation or crop) end information. For example, the transmitter transmits crop_cordinate_x1 information corresponding to starting coordinates within the screen along with crop_cordinate_x2 information of ending coordinates. Herein, the crop_cordinate_x1 information indicates starting coordinates of the 16:9 UHD video and the crop_cordinate_x2 information indicates ending coordinates of the 16:9 UHD video.

The receiver receives the 4K (5040×2160) UHD video, and, then, the receiver may disregard the division start information and the division end information and may directly display the 4K (5040×2160) UHD video.

The receiver receives the 4K (5040×2160) UHD video, and, then, the receiver may cut out (or crop) a 16:9 UHD video from the 21:9 UHD video by using the division start information and the division end information and display the cropped video.

According to the second exemplary embodiment, since the 16:9 HD video is transmitted through a separate stream, the receiver may receive and display the 16:9 HD video stream separately from the 4K (5040×2160) UHD video stream.

Therefore, depending upon the performance or function of the receiver, videos having diverse resolution respective to diverse aspect ratios may be displayed. Similarly, this example corresponds to an example of transmitting a 4K video by dividing the corresponding 4K video to multiple videos, and videos respective to higher resolution may also be encoded or decoded by using the above-described method.

FIG. 10 illustrates an example of an encoder encoding high-resolution video data according to a first exemplary embodiment of the present invention. Herein, 21:9 UHD video data of 4K is given as an example of the high-resolution video data. In this drawing, the data related to the video are respectively indicated as A, B, C, D 1 , and D 2 .

An exemplary encoder encoding high-resolution video data may include a base layer encoder ( 110 ), a first Enhancement layer data encoder ( 120 ), and a second Enhancement layer data encoder ( 130 ).

For example, as an exemplary encoder, the encoder encoding a UHD video having an aspect ratio of 21:9 may respectively process and encode base layer data, Enhancement layer 1 data, and Enhancement layer 2 data.

A crop and scale unit ( 111 ) of the base layer encoder ( 110 ) crops the 21:9 UHD video data (A) to 16:9 and reduces its size by performing scaling, thereby outputting the data s 16:9 HD video data (B). A first encoding unit ( 119 ) may encode the 16:9 HD video data as the base layer data and may output the coded data.

A crop unit ( 121 ) of the first Enhancement layer data encoder ( 120 ) crops the 21:9 UHD video data (A) to 16:9. An up-scaler ( 123 ) up-scales the down-scaled data, which are outputted from the crop and scale unit ( 111 ) of the base layer encoder ( 110 ) and outputs the up-scaled data, and a first calculation unit ( 127 ) may output residual data (C) of the 16:9 UHD video by using the data cropped by the crop unit ( 121 ) and the data up-scaled by the up-scaler ( 123 ). A second encoding

may encode the 16:9 UHD video as the Enhancement later 1 data and may output the coded data.

A second calculation unit ( 137 ) of the second Enhancement layer data encoder ( 130 ) may respectively output left side video data (D1) and right side video data (D 2 ), which respectively correspond to cropped data of the 16:9 video data and the cropped data of 21:9 video data by using the 21:9 UHD video data (A) and the data cropped by the crop unit ( 121 ).

Each of the left side video data (D 1 ) and the right side video data (D 2 ) may be respectively identified as information on the left side of the corresponding video and information on the right side of the corresponding video. An example of signaling this information will be described later on. Herein, in this example, the identification information (enhancement_video_direction) of the left side video is given as 0, and the identification information (enhancement_video_direction) of the right side video is given as 1.

When the left side video data (D 1 ) and the right side video data (D 2 ) are transmitted as a single stream, the receiver may perform decoding by using the signaling information. In this case, each of the left side video data (D 1 ) and the right side video data (D 2 ) may be respectively coded or the data may be coded as a single set of video data.

Accordingly, in case of transmitting the left side video data (D 1 ) and the right side video data (D 2 ) through two video streams or through a single stream, signaling may be performed so that the data can be divided (or separated) by using each of the identification information.

A third coding unit ( 130 ) may encode the cropped left side video data (D 1 ) and right side video data (D 2 ) as the Enhancement layer 2 data.

Accordingly, when each of the base layer data, the Enhancement layer 1 data, the Enhancement layer 2 data are received, UHD video or HD video data may be recovered.

In case the receiver recovers the Enhancement layer 2 data, decoding may be performed by using a decoding method that is related to each of the base layer data and the Enhancement layer 1 data, or the decoding may be performed independently. Such decoding method may be decided in accordance with the coding method.

FIG. 11 illustrates an example of original video, which is separated according to the first exemplary embodiment of the present invention, an exemplary resolution of the separated video.

An example (a) corresponding to the upper left portion represents the resolution of a UHD video having a resolution of 5040×2160 of an aspect ratio of 21:9.

A 4K UHD video having an aspect ratio of 21:9 has a resolution of 5040×2160. Herein, the video corresponding to 16:9 may signify a video having a resolution of 3840×2160, which is referred to as 4K UHD of 16:9 in the conventional broadcasting.

An example (b) corresponding to the upper right portion illustrates an exemplary video having a resolution of 3480×2160 within a UHD video having a resolution of 5040×2160 of an aspect ratio of 21:9.

In an example (c) corresponding to the lower center portion, the video having a resolution of 3840×2160 corresponds to the enhancement layer 1 data, and in case of combining the video having a resolution of 600×2160 of the left side and the right side as a single video, the combined video corresponding to a video having a resolution of 1200×2160 includes the enhancement layer 1 data. At this point, at the video level, signaling is required to be performed on the resolution of surplus data, and signaling on left/right information may also be performed so as to indicate a direction of the video.

In this example, the identification information (enhancement_video_direction) of the left side video is given as 0, and the identification information (enhancement_video_direction) of the right side video is given as 1.

Furthermore, the remaining video that is to be included in the enhancement layer 2 will not be limited only to the edge areas on the left/right sides, and, as a remaining section corresponding to an area excluding an arbitrary 16:9 video from the 21:9 video, the respective position may be arbitrarily designated. For example, an exemplary embodiment, wherein the 16:9 video that is to be extracted from the 21:9 video is set as the left side area, and wherein the enhancement layer 2 is configured of the remaining 5:9 video on the right side area. Additionally, the resolution may also be different from one another. For example, in addition to 4K, the video may also be divided (or separated) as described above within respect to a 8K UHD video and may be transmitted accordingly.

FIG. 12 illustrates an example of a decoder decoding high-resolution video data according to a first exemplary embodiment of the present invention. Herein, 21:9 UHD video data of 4K will be given as an example of the high-resolution video data for simplicity in the description. In this drawing, the data related to the video will be respectively indicated as A, B, D 1 , D 2 , and E.

An exemplary decoder decoding high-resolution video data may include at least one of a base layer decoder ( 210 ), a first Enhancement layer data decoder ( 220 ), and a second Enhancement layer data decoder ( 230 ). Depending upon the function of the signal receiving apparatus, decoders having 3 functions may all be included, and a decider of the signal receiving apparatus outputting the already-existing HD video may include only the base layer decoder ( 210 ). In this example, a demultiplexer ( 201 ) may be shared by each of the decoders, or a separate demultiplexer ( 201 ) may be included in each of the decoders.

For example, a decoder decoding the UHD video having the aspect ratio of 21:9 may process and decode each of the base layer data, the Enhancement layer 1 data, and the Enhancement layer 2 data.

A first decoder ( 213 ) of the base layer decoder ( 210 ) may decode the demultiplexed HD video (B) having the aspect ratio of 16:9 and may output the decoded video.

An up-scaler ( 221 ) of the first Enhancement layer data decoder ( 220 ) up-scales the base layer data, which are decoded by the base layer decoder ( 210 ), and outputs the up-scaled data.

A second decoder ( 223 ) may perform scalable decoding by using the base layer data and residual data.

The second decoder ( 223 ) decodes the demultiplexed residual data of 16:9, and the second decoder ( 223 ) may recover the UHD video (E) having the aspect ratio of 16:9 by using the up-scaled base layer data and the decoded residual data of 16:9.

Meanwhile, a third decoder ( 233 ) of the second Enhancement layer data decoder ( 230 ) decodes the left side/right side video, and the third decoder ( 233 ) merges the outputted UHD video (E) of 16:9 and the decoded left side/right side video (D 1 /D 2 ) by using the Enhancement layer 1 data, which are decoded by the first Enhancement layer data decoder ( 220 ), and may then recover the 21:9 UHD video (A).

In this case, the second Enhancement layer data decoder ( 230 ) may use identification information for identifying the left side/right side video, and boundary filtering may be performed, so that the 21:9 UHD video (A) can be continuously and naturally displayed at a portion where the left side/right side video are being merged. In this case, the cropped video corresponding to the cropped left side/right side video undergoes a filtering process for being merged with the 16:9 video.

Herein, although the filtering process may be similar to deblocking filtering, which is used in the conventional (or legacy) codec, instead of being applied to all boundaries of the macro block, the filtering process is applied to the surroundings of the cropped video. Just as the conventional deblocking filter, in order to differentiate the boundary, which is generated by merging (or connecting) the actual edge and the cropped portion, filtering may be performed in accordance with a threshold value. This will be described later on.

FIG. 13 illustrates an example of merging and filtering cropped videos of the first exemplary embodiment of the present invention. Herein, an example of removing (or eliminating) a blocking artifact from the boundary of the base layer video, the enhancement layer 1 video, and the enhancement layer 2 video will be described.

In this drawing, for example, among the cropped videos with respect to a merged surface, if a left side video and a right side video are separated (or divided or cropped) and encoded, since a blockage artifact occurs at a stitched portion, blurring is performed at the corresponding boundary area. Filtering may be performed in order to differentiate the boundary, which is generated due to cropping, from the edge of the actual video. A method for performing filtering consists of decoding the left and right side videos each having a size of 600×2160 and then merging the decoded video with the 16:9 UHD video, so as to re-configure a video of 21:9, and then performing filtering by using an arbitrary number of pixels along left-and-right horizontal directions. This drawing corresponds to an example of applying filtering respective to 8 pixels along the left-and-right horizontal directions, wherein coordinates information of the stitched portion can be used.

In this drawing, addresses of pixels included in one field are respectively marked as Pi and qi at the merged portion of the first video and the second video, wherein i is assigned with an integer value starting from 0 in accordance with the x-coordinate. An increasing direction of I may vary at the merged portion of the first video and the second video. It will be assumed that an address of pixels along the x-axis of the merged portion corresponds to 596 , 597 , 598 , 599 (pixels with the first video), 600 , 601 , 602 , and 603 (pixel with the second video).

In order to acquire a condition for satisfying Condition 1, which is shown in Equation 1, values P 0 , P 1 , P 2 . . . satisfying Equation 2 to Equation 4 are updated to values P 0 ′, P 1 ′, P 2 ′ by using a 4-tap filter and a 5-tap filter.

Equation 1 represents Condition 1. (Abs( p .sub.2 −p .sub.0)<β)(Abs( p .sub.0 −q .sub.0)<((α K 2)+2)) Equation 1 p′ .sub.0=( p .sub.2+2* p .sub.1+2* p .sub.0+2* q .sub.0 +q .sub.1+4) K 3 Equation 2 p′ .sub.1=( p .sub.2 +p .sub.1 +p .sub.0 +q .sub.0+2) K 2 Equation 3 p′ .sub.2=(2* p .sub.3+3* p .sub.2 +p .sub.1 +p .sub.0 +q .sub.0+4) K 3 Equation 4

Herein, each of the actual edge and blocking artifact may be differentiated from one another by using Condition 1, which is related to Equation 2 to Equation 4, and Condition 2, which is related to Equation 6.

In case Condition 1 of Equation 1 is not satisfied, as described above, the values of P 0 and q 0 are updated to values of P 0 ′ and q 0 ′ by using a 3-tap filter, as shown in Equation 5. p′ .sub.0=(2* p .sub.1 +p .sub.0 +q .sub.1+2) K 2 Equation 5

Condition 2 of Equation 6 corresponds to a condition for filtering a q block, and, in case this condition is satisfied, as shown in Equation 7 to Equation 9, q 0 , q 1 , and q 2 are updated to values of q 0 ′, q 1 ′, and q 2 ′ by using a 4-tap filter and a 5-tap filter.

Equation 6 represents Condition 2. (Abs( q .sub.2 −q .sub.0)<β)(Abs( p .sub.0 −q .sub.0)<((α K 2)+2)) Equation 6 q′ .sub.0=( q .sub.2+2* q .sub.1+2* q .sub.0+2* q .sub.0 +p .sub.1+4) K 3 Equation 7 q′ .sub.1=( q .sub.2 +q .sub.1 +q .sub.0 +p .sub.0+2) K 2 Equation 8 q′ .sub.2=(2* q .sub.3+3* q .sub.2 +q .sub.1 +q .sub.0 +p .sub.0+4) K 3 Equation 9

In case Condition 2 is not satisfied, the value of q0 is updated to a value of q0′ by using Equation 10. q′ .sub.0=(2* q .sub.1 +q .sub.0 +p .sub.1+2) K 2 Equation 10

α (offset_alpha_value) and β (offset_beta_value) of Conditions 1 and 2 may adjust intensity of the filter by using an offset respective to a QP (quantization parameter). By adjusting the filter intensity by using the offset respective to a QP (quantization parameter), and, accordingly, by adequately allocating an offset of a smoothing filter accordingly, details of the video may be adjusted.

FIG. 14 illustrates a first example of a receiver according to a second exemplary embodiment of the present invention.

According to the second exemplary embodiment of the present invention, a stream of a HD video and a stream of a UHD video may be transmitted through separate streams.

Therefore, a receiver(a) that can display HD video may include a demultiplexer and a decoder, wherein the demultiplexer demultiplexes the HD video stream, and wherein the decoder decodes the corresponding video data, so that a 16:9 HD video can be displayed.

The description continues in the full USPTO document.