1:23-cv-01903
Electronic Scripting Products, Inc. v. Digital Strategy Group, LLC.
I. Executive Summary and Procedural Information
- Parties & Counsel:
- Plaintiff: Electronic Scripting Products, Inc. (Delaware)
- Defendant: Digital Strategy Group, LLC dba 360 Alley (Ohio)
- Plaintiff’s Counsel: Sand, Sebolt & Wernow Co., LPA
- Case Identification: 1:23-cv-01903, N.D. Ohio, 09/29/2023
- Venue Allegations: Venue is alleged to be proper as the Defendant is an Ohio limited liability company that maintains a regular and established place of business in the district.
- Core Dispute: Plaintiff alleges that Defendant's augmented reality and virtual reality development services and products infringe three patents related to determining the absolute position and orientation (pose) of a manipulated object in a three-dimensional environment.
- Technical Context: The technology concerns using on-board sensors, such as cameras on smartphones or AR headsets, to track a device's own position and orientation in real space by observing features in the surrounding environment, a foundational capability for modern augmented and virtual reality applications.
- Key Procedural History: The complaint does not mention any prior litigation, Inter Partes Review proceedings, or licensing history related to the patents-in-suit.
Case Timeline
| Date | Event |
|---|---|
| 2004-01-30 | Earliest Priority Date Asserted for ’559, ’641, and ’540 Patents |
| 2010-11-02 | U.S. Patent No. 7,826,641 Issues |
| 2016-01-05 | U.S. Patent No. 9,229,540 Issues |
| 2019-01-29 | U.S. Patent No. 10,191,559 Issues |
| 2023-09-29 | Complaint Filed |
II. Technology and Patent(s)-in-Suit Analysis
U.S. Patent No. 10,191,559 - "Computer Interface For Manipulated Objects With An Absolute Pose Detection Component"
The Invention Explained
- Problem Addressed: The patent addresses the need for an efficient, accurate, and low-cost system for determining the absolute position and orientation (or "pose") of a hand-held object, such as a remote control or gaming wand, as it moves within a real three-dimensional environment. (’559 Patent, col. 2:16-27).
- The Patented Solution: The invention proposes a manipulated object with an on-board photodetector (e.g., a camera) that observes "high optical contrast features" in the surrounding environment. A controller on the object then analyzes the data from the photodetector to determine the object's pose. This optical data can be supplemented with information from an auxiliary motion sensor, like an inertial device, to improve tracking. (’559 Patent, Abstract).
- Technical Importance: This approach allows a device to determine its own location in space without relying on external tracking cameras, a concept central to modern mobile augmented reality and standalone virtual reality headsets. (’559 Patent, col. 3:4-14).
Key Claims at a Glance
- The complaint asserts independent claim 1. (Compl. ¶9).
- Claim 1 requires, in essence:
- A manipulated object that cooperates with high optical contrast features in a 3D environment.
- A photodetector on the object to detect those features and generate data about their positions.
- A controller on the object to identify a "derivative pattern" from the photodetector data, with this pattern being indicative of the photodetector's position.
- At least one additional component, such as an auxiliary motion detector, an active illumination component, or a scanning component.
- The complaint also asserts dependent claims 6, 7, 10, 15, 16, 19, 24, and 25. (Compl. ¶12).
U.S. Patent No. 7,826,641 - "Apparatus And Method For Determining An Absolute Pose Of A Manipulated Object In A Real Three-Dimensional Environment With Invariant Features"
The Invention Explained
- Problem Addressed: The patent identifies a problem with prior art manipulated objects (e.g., gaming implements) that they lack a "sufficiently robust and rapid absolute pose determination system," often relying instead on relative motion tracking which can lead to inaccuracies. (’641 Patent, col. 1:43-48).
- The Patented Solution: The invention describes an apparatus where an "optical measuring means" is placed on-board the manipulated object to infer its absolute pose by observing at least one "invariant feature" in the environment. A processor then prepares this pose data and a communication link transmits a subset of it to an application, enabling the object's real-world motion to be mapped into a digital space. (’641 Patent, Abstract; Fig. 1).
- Technical Importance: The system provides a method for achieving a "one-to-one motion mapping between real space and cyberspace" without requiring complex external tracking infrastructure. (’641 Patent, col. 1:59-62).
Key Claims at a Glance
- The complaint asserts independent claim 1. (Compl. ¶15).
- Claim 1 requires, in essence:
- An apparatus for processing absolute pose data from a manipulated object.
- At least one invariant feature in the 3D environment.
- An on-board "optical measuring means" for optically inferring the object's absolute pose using the invariant feature.
- A processor for preparing the absolute pose data and identifying a subset of it.
- A communication link for transmitting that subset to an application.
- The complaint also asserts dependent claim 29. (Compl. ¶18).
Multi-Patent Capsule: U.S. Patent No. 9,229,540 - "Deriving Input From Six Degrees Of Freedom Interfaces"
- Technology Synopsis: This patent describes an interface that produces computer input based on the absolute pose of an item (e.g., a wearable device) in a 3D environment. The system uses an on-board unit to receive optical inputs from a stationary object and employs a computer vision algorithm using homography to recover the item's absolute pose, which is then used to vary an aspect of an application. (’540 Patent, Abstract).
- Asserted Claims: The complaint asserts independent claim 1 and dependent claims 2, 11-15, 17-18, 25, 32, 36, 37, 39, 40, 44-45, and 47-49. (Compl. ¶21, 24).
- Accused Features: The complaint accuses interfaces such as "WebAR/WebXR or AR Headsets" that use "Inside-out tracking systems" with on-board cameras to locate a user in 3D space. (Compl. ¶23).
III. The Accused Instrumentality
Product Identification
- The "Accused Products" are augmented or virtual reality products and services developed, sold, or offered by Defendant 360 Alley. (Compl. ¶10, 16, 22). This includes applications for mobile devices like the Apple iPhone and Android phones, as well as interfaces for AR Headsets like the HoloLens. (Compl. ¶11, 23).
Functionality and Market Context
- The Accused Products are alleged to use the on-board cameras of mobile devices or headsets to detect high-contrast or invariant features in the user's real-world environment. (Compl. ¶11, 17). The complaint alleges these devices use software platforms like Apple's ARKit and Google's ARCore, along with on-board processors and motion sensors (like IMUs), to track the device's position and orientation. (Compl. ¶11). The complaint provides a screenshot of an augmented reality coloring book application called "Interactive Matt" as a demonstration project. (Compl. p. 4). This functionality is used to create custom digital experiences for web, mobile, glasses, or AR headsets for clients. (Compl. p. 3).
IV. Analysis of Infringement Allegations
U.S. Patent No. 10,191,559 Infringement Allegations
| Claim Element (from Independent Claim 1) | Alleged Infringing Functionality | Complaint Citation | Patent Citation |
|---|---|---|---|
| A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said manipulated object comprising: | Defendant uses a mobile device, such as an iPhone or Android phone, which cooperates with features like table edges or markings in a coloring book. | ¶11 | col. 9:35-40 |
| a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data... | The camera of the iPhone or Android phone acts as the photodetector to detect the optical features and generate data. | ¶11 | col. 1:56-58 |
| b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data... | The phone's processing unit(s) act as the controller, using software like Apple ARKit or Google ARCore to identify a derivative pattern indicative of position. | ¶11 | col. 1:59-63 |
| c) at least one component selected from the group consisting of an auxiliary motion detection component, an active illumination component and a scanning component. | The phone's auxiliary motion detection components, such as an Inertial Measurement Unit (IMU), are used. | ¶11 | col. 2:62-65 |
- Identified Points of Contention:
- Scope Questions: A central question may be whether the feature-tracking algorithms of modern AR platforms like ARKit and ARCore, which identify and track points in a video feed, meet the claim limitation of identifying a "derivative pattern" of "high optical contrast features." The analysis will likely explore how the patent defines "derivative pattern" versus how the accused software actually operates.
- Technical Questions: The complaint alleges that ARKit "recognizes notable features" and ARCore "is constantly improving its understanding of the real world environment by detecting feature points and planes." (Compl. ¶11). An evidentiary question will be whether these generalized "feature points" constitute the "high optical contrast features" contemplated by the patent, which provides examples such as object edges and special markings. (’559 Patent, col. 9:37-39).
U.S. Patent No. 7,826,641 Infringement Allegations
| Claim Element (from Independent Claim 1) | Alleged Infringing Functionality | Complaint Citation | Patent Citation |
|---|---|---|---|
| An apparatus for processing absolute pose data derived from an absolute pose of a manipulated object in a real three-dimensional environment, said apparatus comprising: | Defendant provides an apparatus (a mobile device such as an iPhone or Android) for processing pose data. | ¶17 | col. 9:4-8 |
| a) at least one invariant feature in said real three-dimensional environment; | The apparatus uses at least one invariant feature, such as special markings on the pages of a coloring book. | ¶17 | col. 9:32-35 |
| b) an optical measuring means for optically inferring said absolute pose from on-board said manipulated object using said at least one invariant feature... | The camera of the iPhone or Android phone serves as the optical measuring means to infer the absolute pose from the feature. | ¶17 | col. 9:11-13 |
| c) a processor for preparing said absolute pose data and identifying a subset of said absolute pose data; and | The device's processing unit(s) act as the processor to prepare the pose data and identify a subset of that data. | ¶17 | col. 9:25-29 |
| d) a communication link for transmitting said subset to an application. | An internal communication link on the phone is used to transmit the subset of data to an application running on the device. | ¶17 | col. 9:30-34 |
- Identified Points of Contention:
- Scope Questions: The claim requires an "optical measuring means." Practitioners may question whether a general-purpose smartphone camera, coupled with separate application software (ARKit/ARCore), constitutes the claimed "means," which could be subject to interpretation under 35 U.S.C. § 112(f) as a means-plus-function limitation.
- Technical Questions: The claim requires "inferring said absolute pose." The complaint points to ARKit/ARCore functionality. A key technical question will be what level of "inference" is performed by the accused systems and whether it aligns with the process described in the patent, which discusses calculating Euler angles and world coordinates. (’641 Patent, col. 7:21-26).
V. Key Claim Terms for Construction
The Term: "derivative pattern" (’559 Patent, Claim 1)
Context and Importance: This term is central to the infringement theory for the ’559 Patent, as it describes what the "controller" must identify from the photodetector data. Its construction will determine whether the output of modern AR tracking algorithms falls within the scope of the claim.
Intrinsic Evidence for Interpretation:
- Evidence for a Broader Interpretation: The specification states that the derivative pattern "is indicative of the asymmetric and generally linear pattern." (’559 Patent, col. 6:33-35). This could suggest that any data structure representing the observed environmental features could qualify.
- Evidence for a Narrower Interpretation: The patent explains that as the photodetector's pose changes, the pattern "undergoes a well-understood transformation (i.e., perspective distortion...)." (’559 Patent, col. 6:35-38). This might suggest the "derivative pattern" must be a specific geometrical representation of features that is subject to perspective transformation, potentially narrowing its scope.
The Term: "invariant feature" (’641 Patent, Claim 1)
Context and Importance: The infringement theory for the ’641 Patent relies on the accused devices tracking "invariant features" like markings in a coloring book. The definition of this term will be critical to determine if it can read on the types of environmental characteristics tracked by systems like ARKit/ARCore, which often rely on algorithmically-identified, transient "feature points" rather than pre-defined physical markings.
Intrinsic Evidence for Interpretation:
- Evidence for a Broader Interpretation: The specification describes invariant features broadly as "stationary references such as ground planes, reference surfaces, lines, solids, fixed points and other invariant features disposed in the real three-dimensional environment." (’641 Patent, col. 1:39-43). This language could support a broad reading covering any stable environmental reference.
- Evidence for a Narrower Interpretation: The patent's examples focus on physical and often pre-defined features, such as "edges of objects, special markings, or light sources." (’641 Patent, col. 9:35-39). This could support a narrower construction limited to physically distinct, static characteristics rather than algorithmically generated tracking points.
VI. Other Allegations
- Indirect Infringement: The complaint alleges induced infringement for all three patents. The basis for inducement is the allegation that the Defendant provided, sold, or promoted the Accused Products "along with specific instructions or training" that actively induced end-users to perform the claimed methods, thereby causing direct infringement. (Compl. ¶34, 47, 60).
- Willful Infringement: Willfulness is alleged for all three patents. The complaint bases this allegation on the Defendant having had "knowledge and notice" of each patent and its own infringement "since at least the date of the filing of this Complaint." (Compl. ¶28, 41, 54). This wording suggests a basis for post-suit willfulness only.
VII. Analyst’s Conclusion: Key Questions for the Case
- A core issue will be one of technical mapping: will the functionality of modern, complex AR software platforms like Apple's ARKit and Google's ARCore be found to practice the specific steps recited in the patents, such as identifying a "derivative pattern" ('559 Patent) or using an "optical measuring means" to "infer" an absolute pose ('641 Patent)? This will likely require a detailed comparison of the accused software's operation against the patents' descriptions of the inventive process.
- A second key question will be one of definitional scope: can terms like "high optical contrast features" ('559 Patent) and "invariant feature" ('641 Patent), rooted in patent descriptions that emphasize physical markings and edges, be construed to cover the dynamically-identified and often transient environmental "feature points and planes" used by modern, algorithm-driven AR systems?
- A final evidentiary question will be one of inducement: what specific "instructions or training" did the Defendant provide to its clients or end-users, and does that evidence demonstrate a specific intent to encourage infringement of the patented methods, as required to prove a claim for induced infringement?