Patent Yard Sign in
Lapsed, fee not paid

Multiple devices multimedia control

US 8,799,495 B2 · Assignee: AT&T Intellectual Property I, LP · Inventors: Wohlert; Randolph et al.

USPTO PDF

Overview

Sheet 1 of 18 from the published document. All sheets in the USPTO PDF

Abstract From the patent

The claimed subject matter provides systems and/or methods that effectuate initiating, transferring, manipulating, and/or maintaining simultaneous real time streaming of multimedia content. The system can include devices and components that synchronize multimedia distribution to disparate user devices, distribute media streams to the disparate user devices, and provide media control over the media streams by the disparate user devices.

Why it's free to use

  • The USPTO Official Gazette of September 29, 2026 lists it as expired on August 5, 2026 for an unpaid maintenance fee.
  • It isn't on any reinstatement notice published since.
  • Its 1 US relative has also lapsed, expired or never issued.
  • It lapsed only recently. Owners can still pay late and reinstate it, most often in the first months; we check every new notice. We check US rights only. Check foreign counterparts before selling abroad.
FiledDecember 17, 2008
GrantedAugust 5, 2014
Expired (fee)August 5, 2026
Application number12/336881
Classification (CPC)H04N21/64322 +4 more
Length24 claims · 30 pages

Background From the patent

Mobile devices and networking technologies have transformed many important aspects of everyday life. Mobile devices, such as smart phones, cell phones, and the like, have become a daily necessity rather than a luxury, communication tool, and/or entertainment center, and can now provide individuals with tools to manage and perform work functions such as reading and/or writing emails, setting up calendaring events such as meetings, providing games and entertainment aspects, and/or store records and images in a permanent and reliable medium. Networking technologies, like the Internet and/or wireless cellular telephone technologies, have provided users with virtually unlimited access to remote systems, information and associated applications. Nevertheless, despite such advances in both mobile device technologies and ancillary network capabilities, the current problem facing users is the inab

Drawings 18

1 of 18 drawing sheets so far from the published document, cropped to the drawing. Every sheet is in the USPTO PDF.

Figures as described

  • FIG. 18 illustrates a block diagram of a computer operable to execute the disclosed system in accordance with an aspect of the claimed subject matter

Claims 24 total, 3 independent

What the patent claimed, word for word. All of it is now free to use.

  1. 1
    Independent claimA system, comprising: a memory to store executable instructions; and a processor, coupled to the memory, that facilitates execution of the executable instructions to perform operations, comprising: receiving, from a first device, selection data representing a set of devices to which multimedia content is to be streamed, wherein the set of devices comprises the first device and the devices of the set of devices are configured to play the multimedia content; receiving, from the first device, a command to initiate synchronized playback of the multimedia content by the set of devices; synchronizing distribution of media streams comprising the multimedia content to the devices of the set of devices; receiving, from at least two devices of the set of devices, at least two other commands, respectively, to control the synchronized playback of the multimedia content by the set of devices; arbitrating a conflict determined to have arisen between the at least two other commands in response to receiving the at least two other commands within a predetermined window of time; and directing control of the synchronized playback of the multimedia content by the set of devices comprising applying the at least two other commands to the media streams based on a resolution of the arbitrating.
  2. 2
    The system of claim 1, wherein the system is an application server of a cellular network that establishes and supports the control of the synchronized playback of the multimedia content.
  3. 3
    The system of claim 1, wherein the devices of the set of devices communicate with the system via different network devices of different access networks to actuate the synchronizing of the distribution, and to communicate the at least two other commands to the system.
  4. 4
    The system of claim 1, wherein the synchronizing comprises, in response to the receiving the command, setting up a streaming media session between a source of the multimedia content and the devices to effectuate synchronized streaming of the media streams to the devices.
  5. 5
    The system of claim 1, wherein the arbitrating comprises assigning a priority for the applying of one of the at least two other commands based on an order of receipt of the at least two other commands.
  6. 6
    The system of claim 1, wherein the arbitrating comprises assigning a priority for the applying of one of the at least two other commands based on priority levels respectively associated with the at least two devices from which the at least two other commands were received.
  7. 7
    The system of claim 6, wherein the arbitrating comprises assigning a priority for the applying of one of the at least two other commands based on priority levels respectively associated with the at least two other commands.
  8. 8
    The system of claim 1, wherein the media streams respectively comprise different media components of the multimedia content and the synchronizing further comprises synchronizing distribution of the different media components of the multimedia content to different devices of the set of devices.
  9. 9
    The system of claim 8, wherein the different devices of the set of devices have different multimedia capabilities and are configured to play the different media components of the multimedia content as a function of the different multimedia capabilities, and wherein the different multimedia components comprise audio and video components.
  10. 10
    The system of claim 1, wherein a first media stream of the media streams comprises an audio component and a second media steam of the media streams comprises a video component, and wherein the synchronizing the distribution further comprises synchronizing distribution of the first media stream to a first device of the set of devices configured to play the audio component and the second media stream to a second device of the set of devices configured to play the video component.
  11. 11
    Independent claimA method, comprising: receiving, by a system comprising a processor, a command from a device of a set of devices to initiate synchronized playback of multimedia content by the set of devices, wherein the devices of the set of devices are configured to play the multimedia content; synchronizing, by the system, distribution of media streams comprising the multimedia content to the devices of the set of devices; receiving, by the system, from devices of the set of devices, other commands, respectively, to control the synchronized playback of the multimedia content by the set of devices; arbitrating a conflict determined to have arisen between the other commands in response to receiving the other commands within a predetermined window of time; and directing, by the system, control of the synchronized playback of the multimedia content by the set of devices comprising applying the other commands to the media streams based on an outcome of the arbitrating.
  12. 12
    The method of claim 11, wherein the other commands comprises a pause command to pause the synchronized playback of the multimedia content.
  13. 13
    The method of claim 11, wherein the wherein the arbitrating comprises assigning a priority for the applying of one of the other commands based on an order of receipt of the other commands.
  14. 14
    The method of claim 11, wherein the arbitrating comprises assigning a priority for the applying of one of the other commands based on priority levels respectively associated with the devices from which the other commands were received.
  15. 15
    The method of claim 11, wherein one device of the devices is permitted to issue one of the other commands at a time.
  16. 16
    The method of claim 15, further comprising, transferring, by the system, a control token that enables the devices to communicate the other commands from a first device of the devices to a second device of the devices.
  17. 17
    The method of claim 11, wherein the arbitrating comprises assigning a priority for the applying of one of the second commands based on priority levels respectively associated with the second commands.
  18. 18
    The method of claim 11, wherein a first media stream of the media streams comprises an audio component and a second media steam of the media streams comprises a video component, and wherein the synchronizing the distribution further comprises synchronizing distribution of the first media stream to a first device of the set of devices configured to play the audio component and the second media stream to a second device of the set of devices configured to play the video component.
  19. 19
    Independent claimA computer readable storage device comprising computer executable instructions that, in response to execution, cause a system to perform operations, comprising: receiving a first command from a first device of a set of devices to initiate synchronized playback of multimedia content by the set of devices, wherein the set of devices are configured to play the multimedia content; synchronizing distribution of media streams comprising the multimedia content to the set of devices; receiving, from the set of devices, second commands to control the synchronized playback of the multimedia content by the set of devices; arbitrating a conflict arising between the second commands in response to determination that the conflict is present and in response to receiving the second commands within a predetermined window of time; and directing control of the synchronized playback of the multimedia content by the set of devices by applying the second commands to the media streams based on a resolution of the arbitrating.
  20. 20
    The computer readable storage device of claim 19, wherein the synchronizing comprises, in response to the receiving the first command, setting up a streaming media session between a source of the multimedia content and the set of devices to effectuate synchronized streaming of the media streams to the set of devices.
  21. 21
    The computer readable storage device of claim 19, wherein the arbitrating comprises assigning a priority for the applying of one of the second commands based on an order of receipt of the second commands.
  22. 22
    The computer readable storage device of claim 19, wherein the arbitrating comprises assigning a priority for the applying of one of the second commands based on priority levels respectively associated with the set of devices from which the second commands were received.
  23. 23
    The computer readable storage device of claim 19, wherein the arbitrating comprises assigning a priority for the applying of one of the second commands based on priority levels respectively associated with the second commands.
  24. 24
    The computer readable storage device of claim 19, wherein a first media stream of the media streams comprises an audio component and a second media steam of the media streams comprises a video component, and wherein the synchronizing the distribution further comprises synchronizing distribution of the first media stream to a first device of the set of devices configured to play the audio component and the second media stream to a second device of the set of devices configured to play the video component.

Claim map

Independent claims stand on their own. The others add detail to the claim they name.

Claim 19 claims build on it
Claim 117 claims build on it
Claim 195 claims build on it

Description

Background

Mobile devices and networking technologies have transformed many important aspects of everyday life. Mobile devices, such as smart phones, cell phones, and the like, have become a daily necessity rather than a luxury, communication tool, and/or entertainment center, and can now provide individuals with tools to manage and perform work functions such as reading and/or writing emails, setting up calendaring events such as meetings, providing games and entertainment aspects, and/or store records and images in a permanent and reliable medium. Networking technologies, like the Internet and/or wireless cellular telephone technologies, have provided users with virtually unlimited access to remote systems, information and associated applications.

Nevertheless, despite such advances in both mobile device technologies and ancillary network capabilities, the current problem facing users is the inability to use different devices with different communication capabilities to meet all their communication needs. In particular, current mobile device technologies and associated network capabilities do not address aspects related to the initiation, transfer, manipulation, or maintenance of streaming multimedia between multiple devices. Accordingly, the subject matter as claimed is directed toward resolving or at the very least mitigating, one or all of the foregoing problems.

Summary

The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed subject matter. This summary is not an extensive overview, and it is not intended to identify key/critical elements or to delineate the scope thereof. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.

Users of communication services can typically utilize different devices with different communication capabilities to meet their communication needs. For instance, users can wish to initiate, transfer, manipulate, or otherwise maintain the simultaneous real time streaming of multimedia components (e.g. video, speech, audio) between multiple devices for a variety of reasons. For example, users can wish to control the coordinated delivery of simultaneous multimedia streams to multiple devices owned by the same user (e.g., to take advantage of the different video and audio capabilities of the different devices such as, high definition television, surround sound stereo, home speaker phone, and the like), or to control shared multimedia content in real time across multiple devices owned by others (e.g., who may be in different geographical locations). To meet the service requirements of at least the foregoing scenarios, the claimed subject matter can enable one or more users to control multimedia streams across multiple devices from one (e.g., a user's mobile device) or more devices interoperating with one or more access networks interworking with one or more core networks. Synchronization, content, and distribution functions necessary to effectuate the foregoing can be provided by disparate or the same core network and/or end user devices.

To the accomplishment of the foregoing and related ends, certain illustrative aspects of the disclosed and claimed subject matter are described herein in connection with the following description and the annexed drawings. These aspects are indicative, however, of but a few of the various ways in which the principles disclosed herein can be employed and is intended to include all such aspects and their equivalents. Other advantages and novel features will become apparent from the following detailed description when considered in conjunction with the drawings.

Brief description of the drawings

FIG. 1 illustrates a machine-implemented system that provides multimedia control over multiple disparate and/or distinct devices in accordance with an aspect of the claimed subject matter.

FIG. 2 illustrates a machine-implemented system that facilities and/or effectuates the initiation, transfer, manipulation, or maintenance of simultaneous real time streaming of multimedia between multiple devices in accordance with an aspect of the claimed subject matter.

FIG. 3 illustrates a machine-implemented system that enables users to initiate, transfer, manipulate, or otherwise maintain the simultaneous real time streaming of multimedia between multiple devices in accordance with an aspect of the claimed matter.

FIG. 4 illustrates a further machine-implemented system that actuates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia between a plurality of diverse devices in accordance with an aspect of the claimed subject matter.

FIG. 5 illustrates another machine-implemented system that effectuates and/or facilitates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia between various diverse devices in accordance with an aspect of the claimed subject matter.

FIG. 6 illustrates a system implemented on a machine that facilitates and/or actuates the transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a variety of disparate devices in accordance with various aspects of the claimed subject matter.

FIG. 7 illustrates yet another system implemented on a machine that effectuates the manipulation, transfer, and/or maintenance of simultaneous real time streaming of multimedia content between a plethora of disparate and geographically dispersed devices in accordance with one or more aspects of the claimed subject matter.

FIG. 8 illustrates a machine implemented system that facilitates and/or effectuates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a wide disparity of devices in accordance with various aspects of the claimed matter.

FIG. 9 illustrates a machine implemented system that effectuates initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a disparity of devices in accordance with various aspects of the claimed matter.

FIG. 10 illustrates yet another illustrative machine implemented system that initiates, transfers, manipulates, and/or allows for the maintenance of simultaneous real time streaming of multimedia content between a diversity of devices in accordance with aspects of the claimed matter.

FIG. 11 illustrates a system implemented on a machine that allows for the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between diverse devices in accordance with various aspects of the claimed matter.

FIG. 12 illustrates a system that initiates, transfers, manipulates, and/or allows for the maintenance of simultaneous real time streaming of multimedia content between a disparity of devices in accordance with one or more aspects of the claimed subject matter.

FIG. 13 illustrates a system that provides for the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of content between diverse devices in accordance with an aspect of the claimed matter.

FIG. 14 illustrates a further system implemented on a machine that initiates, transfers, manipulates, and/or allows for the maintenance of simultaneous real time streaming of multimedia content between various disparate devices in accordance with an aspect of the claimed subject matter.

FIG. 15 illustrates a system implemented on a machine that provides for the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of content between diverse devices in accordance with an aspect of the claimed matter.

FIG. 16 illustrates a machine implemented system that provides for the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of content between diverse devices in accordance with an aspect of the claimed matter.

FIG. 17 illustrates a flow diagram of a machine implemented methodology that facilitates and/or effectuates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a wide disparity of devices in accordance with various aspects of the claimed matter.

FIG. 18 illustrates a block diagram of a computer operable to execute the disclosed system in accordance with an aspect of the claimed subject matter.

Detailed description

The subject matter as claimed is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding thereof. It may be evident, however, that the claimed subject matter can be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate a description thereof.

Users of communication services are increasingly attempting to use different devices with different communication capabilities to meet their communication needs. Users can wish to initiate, transfer, manipulate, or otherwise maintain the simultaneous real time streaming of multimedia components (e.g., video, speech, audio) between multiple devices for a variety of reasons. For example, users can wish to control the coordinated delivery of simultaneous multimedia streams to multiple devices owned by the same user (e.g., to take advantage of the different video and audio capabilities of the different devices (e.g., high definition television, surround sound stereo, home speaker phone), additionally and/or alternatively users, users can wish to share multimedia content in real time across multiple devices owned by others (e.g., who may be in different or disparate geographic locations). In accordance with aspects set forth herein, and in order to achieve the foregoing, the claimed subject matter can effectuate and/or facilitate multimedia control by one or more devices, interoperating with one or more access networks, and/or interworking with one or more core networks. Moreover, functionalities and/or facilities necessary to accomplish such multimedia control, for example, synchronization, signal relaying, content, and/or distribution, can be supplied by different components or sub-components within the same or separate core networks or end user devices. Furthermore as will be appreciated by those moderately conversant in this field of endeavor, user devices can consist of a wide array of wireless and/or wired devices with varying capability, including, for instance, cell phones, smart phones, laptop computers, Tablet PCs, multimedia Internet enabled phones, televisions, media servers, wired phones, digital video recorders (DVRs), and the like.

Turning now to FIG. 1 that provides a basic overview of the claimed subject matter and illustrates the need for, service requirements, and underlying concepts of the claimed subject matter. FIG. 1 illustrates a system 100 that provides multimedia control over multiple disparate and/or distinct devices in accordance with an aspect of the claimed subject matter. It should be noted without limitation or loss of generality that the disparate and/or distinct devices can include both geographically dispersed devices (e.g., a different country, state, city, location in a city, etc.) as well as devices that are situated in close proximity (e.g., in the next room, contiguous with one another, and the like). In furtherance of this illustration and to put the claimed matter in context consider the following example that for the most part informs the claimed subject matter, where Jane is browsing the Internet on her cell phone 104, which supports multimedia (e.g., video, speech, audio, . . . ). During the course of her browsing Jane finds her cousin's latest video on the Internet (e.g., a video sharing website where users can upload, view, and share video clips, and the like). Understandably, Jane is excited about the video, and wants to share it with the other members of her family, and talk to them about it. In order to facilitate the foregoing, Jane uses her cell phone 104 to call her father on his mobile device 106. Her father is also excited about the video and gathers the family members together in the living room of their home and transfers the speech from his mobile device 106 to the speaker phone 108 located in the family room so that the entire family can hear about the video and talk about it and share in this experience. To accomplish this Jane using her cell phone 104 sets up a video stream from the Internet video sharing website where her cousin's latest video clip has been uploaded to an application server 102 which then simultaneously streams the video clip to both Jane's cell phone 104 as well as the family's high definition television (HDTV) 110.

When everyone is ready, Jane through her cell phone 104 and in concert with facilities and functionalities associated with application server 102 starts the video playing both on Jane's cell phone 104 as well as on the family's high definition television (HDTV) 110. As the video plays Jane can provide insightful comments about the different parts of the video through her cell phone 104 (e.g., using the sound system associated with high definition television (HDTV) 110 and/or through the speaker phone 108), and further she can occasionally pause the video to provide comments. Moreover, when Jane's father has questions or wants to pause the video to say something, he too can pause the video using the control capabilities provided by his mobile device 106.

It should be noted in regard to the foregoing scenario, without limitation or loss of generality, that multimedia and/or the streaming of multimedia can be controlled exclusively by a single device (e.g., Jane's cell phone 104 at the beginning), control can then be transferred between users and/or devices as necessary and/or as required, control can also be shared between multiple devices and/or users (e.g., Jane's cell phone 104 and her father's mobile device 106), and devices (e.g., high definition television (HDTV) 110, speaker phone 108, etc.) can be dynamically added or removed to share content as the need dictates.

From the foregoing synoptic overview, those of moderate skill in the art will appreciate that the claimed subject matter provides systems and methods that enable users to initiate, transfer, manipulate, or otherwise maintain the simultaneous real time streaming of multimedia (e.g., video, speech, and/or audio) between multiple devices. Additionally, the claimed matter enables the coordinated delivery of simultaneous multimedia streams to multiple devices owned by the same or different users, facilitates one or more users to control multimedia streams across multiple devices from one or more devices interoperating with one or more access networks interworking with one or more core networks and allowing for separate session and media control signaling, and further enables key functions (e.g., command provision, signaling synchronization, signaling relay, content provision, and content distribution) to be flexibly supplied in a variety of configurations by different or the same core network or end user devices.

In order to actuate the foregoing functionalities and/or facilities, the claimed matter can utilize a set of components that can be flexibly interworked to provide the necessary functionality in a variety of communication configurations. This set of components can provide a core network entity, such as an application server 102 or a similar entity to establish, synchronize, and/or otherwise maintain media streams between multiple disparate devices (e.g., Jane's cell phone 104, her father's mobile device 106, the family's speaker phone 108, and/or the family's high definition television (HDTV) 110, etc.).

In order to establish, synchronize, and/or maintain media streams between multiple devices, the claimed subject matter can employ control signaling wherein a signal can be transmitted from one or more user devices, through one or more access networks, and through one or more core networks, to the core network entity (e.g., application server 102) providing the synchronization functionality. Thus, the network entity that provides synchronization functionality, such as an application server 102 that utilizes session initiation protocol (SIP), can be interposed in the control path for manipulation of the media stream(s). It should be noted in this context, without limitation or loss of generality, that separate control signaling can be used for the session and media components of the claimed subject matter.

In addition, to achieve the necessary synchronization, a synchronization functionality that interfaces with a content distribution aspect can be utilized. The synchronization functionality can ensure that the same sequential place in the stream is provided at the same time to each of the end user devices (e.g., Jane's cell phone 104, Jane's father's mobile device 106, the family speaker phone 108, and the family high definition television (HDTV) 110) so that the users of these devices can share the same or, at the very least, a substantially similar user experience with respect to the provision of the media. Further the content distribution aspect can provide data replication and streaming functionality. The content distribution aspect can be co-located in the same application server 102 as the synchronization functionality, or it can be provided by a separate server. Where the content distribution functionality is provided by a separate server, industry standard protocols, such as, for example, session initiation protocol (SIP), can be employed to exchange control signaling between the synchronization and content distribution aspects where these are situated on separate servers.

Moreover, in regard to the content distribution functionalities set forth and utilized herein by the claimed subject matter, the content distribution aspect can obtain multimedia content for distribution (or re-distribution) from the same application server (e.g., application server 102) that supplies the synchronization capability. Additionally and/or alternatively, multimedia content can be received, retrieved, and/or solicited from other disparate sources (e.g., servers, databases, or other devices). As those of ordinary skill in the art will comprehend without limitation or loss of generality, where content is supplied, obtained, elicited, and/or received from separate servers (or services), industry standard protocols (e.g., session initiation protocol (SIP)) can be utilized to exchange signaling and data transmission between the content distribution aspects and the content source aspects. Moreover, as will also be understood by those moderately conversant in this field of endeavor, multimedia streams can be established between a single device or multiple disparate devices and the distribution facility based at least in part on the control information supplied by the control signaling aspect elucidated above.

The foregoing components and/or aspects, the distribution of the facilities and/or functionalities between the components and/or aspects, the processing that can take place in the components and/or aspects, and the control signaling and data transmission between the components can be provided in a variety of component configurations. As will no doubt be understood by persons of reasonable skill in the art, each of these disparate component configurations can impose different interfacing requirements between the components and/or aspects.

It should be noted in connection with the following illustrative configurations that in order to avoid undue complexity, in the following configurations only the key components are illustrated. Common communication network interconnecting entities such as session border controllers, media gateways, and the like, are not depicted.

Functions and facilities that are illustrated can include content components that can provide the source of the multimedia content that is shared by the users and distribution components that can replicate and transmit the content to the users. Additional facilities and functionalities can include control components that can provide the command structure necessary to control a multimedia session setup and/or the source of commands that control multimedia content (e.g., play, pause, rewind, fast-forward, add a user, drop a user, etc.), synchronization aspects that can provide for the collection of commands from users, replication and transmission of commands to users, arbitration of conflicting commands from different users, and the like, and relay capabilities that can be utilized to pass commands from one source to another destination (which may or may not be known to the original source).

It should be noted without limitation or loss of generality that in the configurations portrayed as follows, control can be provided by one or more devices, interoperating with one or more access networks, and interworking with one or more core networks. Moreover, signaling and data transmission between components can be accomplished by one or more industry common signaling and data transmission protocol (e.g., session initiation protocol (SIP), real time streaming protocol (RTSP), hypertext transfer protocol (HTTP), extensible markup language (XML), etc.) and synchronization, signal relaying, content, and distribution functions can be performed by different entities, such as application servers or content servers, or other entities within the same or distinct but separate core networks or end user devices. The end user devices contemplated to be utilized in conjunction with the claimed subject matter can include a wide variety of wireless and/or wireline devices with varying capability, including for example, cell phones, smart phones, laptop computers, Tablet PCs, desktop computers, consumer and/or industrial devices and/or appliances and/or instrumentation, hand held devices, personal digital assistants, multimedia Internet enabled phones, multimedia players, wired telephones, televisions, digital video recorders (DVRs), personal video recorders (PVRs), media servers, and the like.

FIG. 2 provides illustration of a system 200 that facilities and/or effectuates the initiation, transfer, manipulation, or maintenance of simultaneous real time streaming of multimedia (e.g., video, speech, and audio) between multiple devices in accordance with an aspect of the claimed subject matter. In this depiction to continue the usage example presented above, Jane shares video with her family wherein she controls from her device the initiation of the streaming of the multimedia content.

As illustrated system 200 can include application server 102 situated in a core network that can be employed to initiate, transfer, manipulate, and/or maintain the simultaneous streaming of multimedia content in real time between a multitude of disparate user devices. Application server 102, via one or more access networks 210, can be in continuous and/or operative or sporadic and/or intermittent communication with a multitude of user devices such as wireless and wireline devices with varying capability, including for instance, cell phones, wired phones, personal computers, personal digital assistants, televisions, digital video recorders (DVRs), media servers, and the like. Application server 102 can be implemented entirely in hardware and/or a combination of hardware and/or software in execution. Further, application server 102 can be incorporated within and/or associated with other compatible components. Additionally, application server 102 can be, but is not limited to, any type of machine that includes a processor and/or is capable of effective communication with access networks 210. Illustrative machines that can comprise application server 102 can include desktop computers, server class computing devices, cell phones, smart phones, laptop computers, notebook computers, Tablet PCs, consumer and/or industrial devices and/or appliances, hand-held devices, personal digital assistants, multimedia Internet mobile phones, multimedia players, and the like.

As depicted application server 102 can include synchronization component 202 that can interface with a distribution component 206 to provide the functionality and/or facilities necessary to ensure that the same sequential place in a media stream is provided at the same instant in time to each of the user devices so that the users of each of the user devices can share the same or a substantially similar user experience with respect to the provision of media supplied by content component 204.

The component configuration provided in FIG. 2 can be considered as a basic functional distribution that minimizes the number of separate components and thereby the signaling and/or data transmission complexity. As illustrated, a control signal can be provided from a control aspect 208 situated in a single user device (e.g., Jane's cell phone 104). The control signal can be transmitted through one or more access networks 210 to application server 102 situated in a core network. The control signaling initiated by control aspect 208 can instigate synchronization component 202 to interface with distribution component 206 to ensure that the same sequential place in the media stream is provided at the same time to each and all of the participating end user devices. Based at least in part on input from synchronization component 202, distribution component 206 can access content component 204 in order to obtain multimedia content that distribution component 206 can replicate and stream to the various participating user devices.

FIG. 3 depicts a system 300 that enables users to initiate, transfer, manipulate, or otherwise maintain the simultaneous real time streaming of multimedia between multiple devices in accordance with an aspect of the claimed matter. To continue the ongoing illustrations regarding Jane and her family, in this usage case either Jane or her father through their respective devices can pause the shared multimedia stream in order to provide commentary. It is to be appreciated that either Jane or her father can resume the video when they are ready to do so. Because much of the configuration and operation of application server 102 and its associated components (e.g., synchronization component 202, content component 204, and distribution component 206) is substantially similar to those described earlier, a detailed description of such features, unless where necessary, has been omitted to avoid needless repetition and for the sake of brevity and conciseness.

As depicted, the control functionality (e.g., control 208 and control 302) has been distributed across multiple devices (e.g., Jane's cell phone 104 and her father's mobile device 106). This enables multiple users to simultaneously control the streaming media emanating from the core network. In this instance, synchronization component 202 can arbitrate between conflicting control signaling emanating from control 208 and/or control 302. Such arbitration can include consideration of user control priority, timing of received signals, etc. Nevertheless, it should be noted without limitation or loss of generality that in all configurations, a mix of controlling and non-controlling devices is possible. User devices without control capabilities can include those that are not capable of this function, for example a wireline plain old telephone (POT) used as a speakerphone (e.g., speakerphone 108).

FIG. 4 illustrates a system 400 that actuates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia between a plurality of diverse devices in accordance with an aspect of the claimed subject matter. In furtherance of the continuing example, in this instance Jane initiates a video sharing session with her family members using the control functionality 208 associated with her cell phone. Once the video sharing session has commenced Jane passes exclusive control to her father who controls the session through the facilities provided by control 302 associated with his mobile device.

As previously noted, for all configurations, control can be provided from only one device, or from multiple devices. FIG. 4 provides illustration of the circumstance when control is being provided by a single device even though the control functionality can exist in multiple devices. Exclusive control can be limited to one of the devices despite the fact that the control functionality resides on multiple devices. Moreover, control capabilities associated with user devices can be passed from one device to another. Accordingly, other devices besides the instigating and controlling user device can have a control function that albeit is temporarily inactive (e.g., does not signal to synchronization component 202; or if control signals are supplied to synchronization component 202 such signaling is ignored or discarded by synchronization component 202).

FIG. 5 depicts a system 500 that effectuates and/or facilitates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia between various diverse devices in accordance with an aspect of the claimed subject matter. The usage case depicted in FIG. 5 envisions a service provider that has several different content servers 502 and distribution servers 506 dispersed throughout a core network. Under this scenario application server 102 can be an interworked application specific service where the synchronization component 202, content component 504, and distribution component 508 are being provided from a common core network but each of these components is situated on disparate servers (e.g., application server 102, content server 502, and distribution server 506, respectively). As will be appreciated by those or moderate skill in the art, dispersion of these functionalities over disparate servers in the core network can introduce additional signaling and/or data transmission interfacing requirements. For example, in addition to control signaling emanating from control 208 and control 302 associated with disparate and/or geographically dispersed user devices, control signaling needs to also be provided from application server 102 to both content server 502 and distribution server 506.

FIG. 6 provides exemplification of a system 600 that facilitates and/or actuates the transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a variety of disparate devices in accordance with various aspects of the claimed subject matter. The usage case illustrated in FIG. 6 pertains to optimizing signaling. To optimize signaling, a service provider typically should enable distributed (e.g., separate) session and media synchronization functionality with signaling from the user device for each. Accordingly, in this scenario session control (e.g., SIP) can be provided between user devices (e.g., control 208 and/or control 302) and application server 102, and media control (e.g., real time streaming protocol (RTSP) for play/forward/rewind, etc.) can run directly between user devices and distribution server 506. Accordingly, two synchronization components can be utilized, one situated on application server 102 (e.g., synchronization component 202) for synchronization and arbitration of session signaling and the other located on distribution server 506 for synchronization and arbitration of media control commands. The session control synchronization component 202 thus can coordinate with the media control synchronization component 602 for setup and tear down of media for a particular session or when adding/removing sessions. It should be noted that the foregoing signaling methodology can be applicable to other component configurations where the distribution functionality provided by distribution server 506, and more particularly distribution component 508, is provided separately from the synchronization functionality provided by synchronization component 202.

FIG. 7 depicts a system 700 that effectuates the manipulation, transfer, and/or maintenance of simultaneous real time streaming of multimedia content between a plethora of disparate and geographically dispersed devices in accordance with one or more aspects of the claimed subject matter. The usage case provided by FIG. 7 illustrates the situation where a service provider already has several different content servers. Multiple device multimedia control capability is introduced by adding an interworked application specific server 102 to the existing infrastructure. It has been observed that the core network signaling and data transmission complexity resulting from providing separate servers for each of the functions provided in the core network can be circumvented and/or mitigated by combining some functions in a common server. Accordingly, as depicted system 700 combines synchronization and distribution components on a common application server 102 while obtaining or soliciting content from (one or more) separate content server(s) such as content server 502, and more particularly, retrieving or eliciting content from content component 702 that can be associated with content server 502.

FIG. 8 illustrates a system 800 that facilitates and/or effectuates the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a wide disparity of devices in accordance with various aspects of the claimed matter. The usage case in this instance relates to A service provider that already has a content server 502 that also provides distribution through a distribution component 502. Multiple device multimedia control capability is introduced by adding an interworked application specific server 102 to the existing infrastructure. It should be noted that this configuration illustrates combining content and distribution functions represented by content component 702 and distribution component 802 in a common content server 502 while providing the synchronization functionality from a synchronization component 202 situated on the interworked but separate or distinct application specific server 102.

FIG. 9 illustrates a system 900 that effectuates initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between a disparity of devices in accordance with various aspects of the claimed matter. As a continuation of the ongoing illustration in connection with Jane and her family, Jane's friend, Mary, now wishes to share a video that has been persisted on Mary's cell phone with the others. As depicted in system 900 this configuration allows for the provisioning of content (e.g., content 902) from any viable device, independent of the control function. Although system 900 illustrates content 902 being supplied from a user device without control per se, the content providing user device could nevertheless also include a control aspect.

FIG. 10 depicts a system 1000 that initiates, transfers, manipulates, and/or allows for the maintenance of simultaneous real time streaming of multimedia content between a diversity of devices in accordance with aspects of the claimed matter. As a further continuation of the ongoing illustration regarding Jane, Jane in this scenario is sharing content from her mother's digital video recorder (DVR). Here by providing content 1002 from user device 1004 (e.g., Jane's mother's DVR), user device 1004 can fulfill the role of both the content provider as well as the content server. In accordance with this aspect however, user device 1004 does not provide a control function, and multimedia is not consumed by a user directly on the device. As such, content is not streamed back to the device providing the content (e.g., user device 1004), but rather control signaling is supplied to content providing device 1004.

FIG. 11 illustrates a system 1100 that allows for the initiation, transfer, manipulation, and/or maintenance of simultaneous real time streaming of multimedia content between diverse devices in accordance with various aspects of the claimed matter. In this instance, Jane is sharing content from her cell phone 1102 and control is shared between Jane and her father. The content on her cell phone 1102 is locally persisted and/or provided (e.g., thereby avoiding lag problems she could otherwise experience). Here it should be noted that where a user has local control of shared content on their device (e.g., 1102), then the shared control from other devices must be provided to the content providing device as well. Thus in addition to the control aspect 208 previously described, user device 1102 can also include synchronization facilities 1108 and the content 1110 being shared amongst the other user devices. Moreover, in order to facilitate and/or effectuate the foregoing a relay component 1106 can be situated or associated with application server 102. Relay component 1106 can pass commands from one source (e.g., user device 1102, control 302, and/or control 1104) to another destination which may or may not be known to the original source.

FIG. 12 provides depiction of a system 1200 that initiates, transfers, manipulates, and/or allows for the maintenance of simultaneous real time streaming of multimedia content between a disparity of devices in accordance with one or more aspects of the claimed subject matter. Once again as a continuation of the ongoing illustration with regard to Jane, in this scenario Jane is sharing content from a digital video recorder (DVR) situated in her home. Thus, she can use her cell phone (e.g., user device 1102) to directly control the digital video recorder (DVR) (e.g., user device 1204) using a Bluetooth radio interface, for example, and thereafter Jane can share control with her friends and family. The configuration provided in FIG. 12 illustrates the fact that if content is provided from a directly controlled device that does not have a core network control signaling relationship (e.g., user device 1204), then shared control must be established through a synchronization function (e.g., synchronization aspect 1108) associated with the device (user device 1102) with the content control relationship (e.g., between user device 1102 and user device 1204 where user device 1102 provides direct control signaling to user device 1204).

The description continues in the full USPTO document.

In this description

About 5,728 words. The USPTO PDF has it with every drawing.

Timeline & family

Timeline From USPTO dates

200920112013201520172019202120232025Application filedDec 17, 2008Application publishedJune 17, 2010Patent grantedAug 5, 20143.5-year fee paidFeb 5, 20187.5-year fee paidFeb 5, 202211.5-year fee not paidFeb 5, 2026Patent expiredAug 5, 2026

Maintenance fees

Fees are due 3.5, 7.5 and 11.5 years after grant. This patent expired on August 5, 2026, so the fee marked "not paid" was the one that went unpaid.

3.5-year feeDue February 5, 2018Paid
7.5-year feeDue February 5, 2022Paid
11.5-year feeDue February 5, 2026Not paid

US family 2 documents, by filing date

Published applicationUS 2010/0153576 A1

MULTIPLE DEVICES MULTIMEDIA CONTROL

Filed Dec 2008 · published Jun 2010
Published application
This documentUS 8,799,495 B2

Multiple devices multimedia control

Filed Dec 2008 · granted Aug 2014
Lapsed, fee not paid

Earlier publications, parents and continuations. None of them can still be enforced, or this patent would not be listed.

Sources & verification

Verification

  • The USPTO Official Gazette of September 29, 2026 lists it as expired on August 5, 2026 for an unpaid maintenance fee.
  • It isn't on any reinstatement notice published since.
  • Its 1 US relative has also lapsed, expired or never issued.
  • Rechecked against USPTO records every day.
  • It lapsed only recently. Owners can still pay late and reinstate it, most often in the first months; we check every new notice. We check US rights only. Check foreign counterparts before selling abroad.

Confirm it yourself

  1. Open the file history on Patent Center.
  2. The status should read "Patent Expired Due to NonPayment of Maintenance Fees Under 37 CFR 1.362".
  3. Check the documents for any later petition to revive or reinstate.

Everything on this page comes from the documents linked above.

More in Cameras, Displays & Optics

All Cameras, Displays & Optics
Drawing from US 8,799,169 B2Lapsed, fee not paid10 drawings
Cameras, Displays & Optics · US 8,799,169 B2

Method for recommendation of audio

A method for recommendation of a content item, comprising: providing first identifiers for first content items stored on a first device; providing second identifiers for second content items stored on a second device;…

Filed2009
LapsedAug 2026
OwnerSony Corporation
Drawing from US 8,799,823 B2Lapsed, fee not paid12 drawings
Cameras, Displays & Optics · US 8,799,823 B2

Display device

A display device includes a display unit, a first display control unit, a title string storing unit, a concatenated string creating unit, a determining unit, a navigation string creating unit, and a second display…

Filed2010
LapsedAug 2026
OwnerBrother Kogyo Kabushiki Kaisha