DCT

1:24-cv-00930

Electronic Scripting Products Inc v. Bendon Inc

Log In

I. Executive Summary and Procedural Information

  • Parties & Counsel:
  • Case Identification: 1:24-cv-00930, N.D. Ohio, 05/28/2024
  • Venue Allegations: Plaintiff alleges venue is proper because Defendant maintains a regular and established place of business in the Northern District of Ohio and has committed acts of infringement in the district.
  • Core Dispute: Plaintiff alleges that Defendant’s augmented reality applications infringe patents related to determining the absolute position and orientation of a manipulated object in a three-dimensional environment using optical and other sensors.
  • Technical Context: The technology at issue is foundational to modern augmented reality (AR), where a device uses its camera to understand its position in the real world to overlay digital information accurately.
  • Key Procedural History: No prior litigation, post-grant proceedings, or licensing history is mentioned in the complaint.

Case Timeline

Date Event
2004-01-30 '559 Patent Priority Date
2006-03-08 '641 Patent Priority Date
2010-11-02 '641 Patent Issue Date
2019-01-29 '559 Patent Issue Date
2024-05-28 Complaint Filing Date

II. Technology and Patent(s)-in-Suit Analysis

U.S. Patent No. 10,191,559 - "Computer Interface For Manipulated Objects With An Absolute Pose Detection Component"

  • Patent Identification: U.S. Patent No. 10,191,559, "Computer Interface For Manipulated Objects With An Absolute Pose Detection Component," issued January 29, 2019. (Compl. ¶7).

The Invention Explained

  • Problem Addressed: The patent’s background section describes a need for a "rapid, low-cost method and apparatus for one-to-one motion mapping between real space and cyberspace." (’559 Patent, col. 1:26-31). It notes that many prior art systems for tracking hand-held objects rely on relative motion, which can lead to "gradual drift and accumulating position error." (’559 Patent, col. 3:1-2).
  • The Patented Solution: The invention proposes a manipulated object, such as a phone or tablet, containing an on-board photodetector (camera) and a controller. (’559 Patent, Abstract). The photodetector observes "high optical contrast features" in the surrounding environment, and the controller analyzes the geometric pattern of these features (e.g., through perspective distortion) to calculate the object's absolute six-degree-of-freedom position and orientation, known as its "pose." (’559 Patent, Abstract; col. 6:26-44). This optical data can be supplemented by information from auxiliary sensors, such as an inertial device. (’559 Patent, Abstract).
  • Technical Importance: This method provides a self-contained system for a handheld device to determine its absolute position and orientation in real-world coordinates, a fundamental capability for augmented reality and other spatial computing applications. (’559 Patent, col. 1:32-41).

Key Claims at a Glance

  • The complaint asserts independent claim 1. (Compl. ¶9).
  • The essential elements of claim 1 are:
    • A manipulated object that cooperates with a plurality of high optical contrast features in a real 3D environment.
    • A photodetector configured to detect the features and generate data representative of their positions.
    • A controller configured to identify a "derivative pattern" from the photodetector data, with this pattern being indicative of the photodetector's position.
    • At least one auxiliary component, such as an "auxiliary motion detection component," an "active illumination component," or a "scanning component."
  • The complaint also asserts dependent claims 6, 7, 10, 15, 16, 19, 24, and 25. (Compl. ¶¶11, 20).

U.S. Patent No. 7,826,641 - "Apparatus And Method For Determining An Absolute Pose Of A Manipulated Object In A Real Three-Dimensional Environment With Invariant Features"

  • Patent Identification: U.S. Patent No. 7,826,641, "Apparatus And Method For Determining An Absolute Pose Of A Manipulated Object In A Real Three-Dimensional Environment With Invariant Features," issued November 2, 2010. (Compl. ¶12).

The Invention Explained

  • Problem Addressed: The patent addresses the challenge of creating a system that can fully "capture successive poses of the manipulated object with a method that accounts for all six degrees of freedom" (i.e., three translational and three rotational axes) to enable one-to-one mapping between the real world and a digital environment. (’641 Patent, col. 2:63-67).
  • The Patented Solution: The invention is an apparatus that determines its own absolute pose by using an on-board optical sensor to observe "invariant features" in the environment. (’641 Patent, Abstract). A key aspect of the patented solution is its system architecture: an on-board processor prepares the absolute pose data, identifies a "subset" of that data required by a specific application, and transmits that subset to the application via a communication link. (’641 Patent, col. 10:25-36; Fig. 1).
  • Technical Importance: This patent describes a complete system architecture for efficiently capturing, processing, and communicating pose data from a handheld device to an application, enabling real-time interactive experiences. (’641 Patent, Abstract).

Key Claims at a Glance

  • The complaint asserts independent claim 1. (Compl. ¶14).
  • The essential elements of claim 1 are:
    • An apparatus for processing absolute pose data from a manipulated object.
    • At least one "invariant feature" in the real 3D environment.
    • An on-board "optical measuring means" for inferring the absolute pose using the invariant feature and expressing it as pose data.
    • A processor for preparing the pose data and "identifying a subset" of it.
    • A "communication link" for transmitting the subset to an application.
  • The complaint also asserts dependent claim 29. (Compl. ¶¶17, 33).

III. The Accused Instrumentality

Product Identification

  • The Accused Products are Bendon’s augmented reality applications for iOS and Android mobile devices, which are designed to work with its physical products, such as coloring and activity books. (Compl. ¶¶9-10).

Functionality and Market Context

  • The accused apps allegedly use a mobile device's camera to recognize and track "high contrast features" such as the "drawings and markings" in an associated augmented reality book. (Compl. ¶10). This allows the app to overlay digital content, such as animated characters, onto the view of the real world. (Compl. p. 4, screenshot). The complaint alleges that on iOS devices, this functionality is enabled by Apple's ARKit framework, which "recognizes notable features in the scene image" and compares this visual data with "motion sensing data." (Compl. ¶10). On Android devices, the functionality is allegedly enabled by Google's ARCore, which works by "detecting feature points and planes." (Compl. ¶10). The screenshot from a product video shows a digital character appearing to stand on a physical "My Little Pony" coloring book viewed through a device. (Compl. p. 4).

IV. Analysis of Infringement Allegations

'559 Patent Infringement Allegations

Claim Element (from Independent Claim 1) Alleged Infringing Functionality Complaint Citation Patent Citation
A manipulated object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment... A mobile device (iOS or Android) running a Bendon AR app, which cooperates with high contrast drawings and markings on an augmented reality book. ¶10 col. 1:1-2
a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data... The camera of the iOS or Android device detects the features of the AR book and generates image data. A screenshot shows the device's camera pointed at a book to generate an AR experience. ¶10(a); p. 5 Abstract
b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector... The processing unit of the iOS or Android device, using ARKit or ARCore, allegedly identifies a derivative pattern from the camera data to determine the device's position. ¶10(b) col. 6:31-34
c) at least one component selected from the group consisting of an auxiliary motion detection component... The iOS or Android device’s inertial measurement unit (IMU) or motion sensing unit, allegedly used by the ARKit or ARCore frameworks. ¶10(c) Abstract
  • Identified Points of Contention:
    • Scope Questions: A central question may be whether the general-purpose feature-point tracking performed by commercial AR frameworks (ARKit/ARCore) constitutes the identification of a "derivative pattern" as that term is used in the patent. The specification describes this pattern in the context of a "well-understood transformation (i.e., perspective distortion)," raising the question of whether the accused functionality performs this specific type of analysis. (’559 Patent, col. 6:35-39).
    • Technical Questions: The complaint alleges the use of an "auxiliary motion detection component" via ARKit and ARCore. A factual question for discovery may be whether Bendon's applications are configured to specifically use, or in fact do use, data from the device's inertial sensors as part of the infringement, or if they rely solely on optical tracking.

'641 Patent Infringement Allegations

| Claim Element (from Independent Claim 1) | Alleged Infringing Functionality | Complaint Citation | Patent Citation |
|:------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| An apparatus for processing absolute pose data derived from an absolute pose of a manipulated object in a real three-dimensional environment... | An iOS or Android mobile device held by a user. | ¶16 | col. 9:16-21 |
| a) at least one invariant feature in said real three-dimensional environment; | The augmented reality book with its drawings and markings. | ¶16(a) | col. 9:37-40 |
| b) an optical measuring means for optically inferring said absolute pose from on-board said manipulated object using said at least one invariant feature and expressing said inferred absolute pose with absolute pose data... | The camera on the iOS or Android device, which infers the device's pose (position and orientation) relative to the AR book. | ¶16(b) | col. 9:31-34 |
| c) a processor for preparing said absolute pose data and identifying a subset of said absolute pose data; and | The processing unit of the iOS or Android device, which allegedly prepares the pose data and identifies a subset for the application. | ¶16(c) | col. 10:25-28 |
| d) a communication link for transmitting said subset to an application. | An internal communication link within the mobile device that transmits the pose data to the Bendon AR app. A screenshot shows the result of this process, with an interactive AR character displayed within the app. | ¶16(d); p. 10 | col. 10:31-33 |

  • Identified Points of Contention:
    • Scope Questions: The infringement theory relies on an internal bus within a smartphone qualifying as the claimed "communication link" transmitting data to an "application" (the Bendon app). The court may need to analyze whether this entirely internal data transfer fits the scope of a "communication link" as contemplated by the patent.
    • Technical Questions: A key factual question will be what processing the accused products actually perform. The analysis may focus on whether the system truly "identif[ies] a subset" of pose data for the application, as required by claim 1(c), or if the underlying AR framework provides a data stream that is used in a different manner. The complaint's assertion that the subset "can include all the pose data" appears to be supported by the patent's specification. (Compl. ¶16(c); ’641 Patent, col. 10:27-29).

V. Key Claim Terms for Construction

  • Term: "derivative pattern" (’559 Patent, Claim 1)

    • Context and Importance: This term is the core of the patented data processing method. The outcome of the case may depend on whether the feature-tracking and world-mapping functions of modern AR frameworks like ARKit and ARCore fall within its scope. Practitioners may focus on this term because it appears to be the primary technical limitation distinguishing the invention from simply using a camera.
    • Intrinsic Evidence for Interpretation:
      • Evidence for a Broader Interpretation: The term is not explicitly defined with restrictive language, potentially allowing it to cover any pattern mathematically derived from the raw photodetector data that is indicative of the device’s position.
      • Evidence for a Narrower Interpretation: The specification provides a specific context, stating that as the photodetector's pose changes, the observed pattern "undergoes a well-understood transformation (i.e., perspective distortion...)." (’559 Patent, col. 6:35-39). This language may be used to argue that the term is limited to the identification of this specific type of geometric transformation.

  • Term: "invariant feature" (’641 Patent, Claim 1)

    • Context and Importance: This term defines what the accused apparatus must be able to optically track in the environment to determine its pose. The complaint maps this limitation to the "drawings and markings" on an AR book. (Compl. ¶16(a)). The construction of this term will determine what types of real-world objects can satisfy the claim.
    • Intrinsic Evidence for Interpretation:
      • Evidence for a Broader Interpretation: The specification provides broad examples, including "high optical contrast features such as edges of objects, special markings, or light sources." (’641 Patent, col. 9:37-40). This supports reading the term on a wide variety of visually distinguishable objects.
      • Evidence for a Narrower Interpretation: An argument could be made that "invariant" implies a feature that is fixed or permanent in a way that the computationally-derived "feature points" identified by ARKit/ARCore are not. However, the patent’s own examples of "edges of objects" and "markings" appear to align with the complaint's allegations.

VI. Other Allegations

  • Indirect Infringement: The complaint alleges that Bendon induces infringement of both patents by providing its AR apps to end-users with "specific instructions or training regarding the use of those products," thereby causing them to directly infringe. (Compl. ¶¶25-28, 38-41).
  • Willful Infringement: Willfulness is alleged for both patents based on knowledge that Bendon has had "since at least the date of the filing of this Complaint." (Compl. ¶¶21, 34). This frames the willfulness allegations as arising from post-suit conduct.

VII. Analyst’s Conclusion: Key Questions for the Case

  • A core issue will be one of definitional scope: can the term "derivative pattern" from the ’559 Patent, which the specification ties to "perspective distortion," be construed to cover the general-purpose feature-point detection and tracking algorithms used by modern AR frameworks such as Apple’s ARKit and Google’s ARCore?
  • A second issue will concern system architecture: does the internal data flow within a smartphone running the accused app meet the limitations of the ’641 Patent's system claim, specifically by "identifying a subset" of pose data and transmitting it over a "communication link" to the "application" as those terms are understood in the patent?
  • A final key question will be evidentiary: for the claims of inducement and willfulness, the case will likely depend on evidence developed during discovery that establishes Bendon’s pre-suit knowledge of the patents and its specific intent to cause infringement, facts not alleged in the initial complaint.