+ All Categories
Home > Documents > Paper No. Filed on behalf of: Mitek Systems, Inc. By...

Paper No. Filed on behalf of: Mitek Systems, Inc. By...

Date post: 03-Mar-2018
Category:
Upload: vuongkiet
View: 218 times
Download: 2 times
Share this document with a friend
67
Paper No. __ Filed: January 26, 2015 Filed on behalf of: Mitek Systems, Inc. By: Naveen Modi Joseph E. Palys Paul Hastings LLP 875 15th Street NW Washington, DC 20005 Telephone: (202) 551-1990 Facsimile: (202) 551-0490 E-mail: [email protected] [email protected] UNITED STATES PATENT AND TRADEMARK OFFICE ____________________ BEFORE THE PATENT TRIAL AND APPEAL BOARD ____________________ MITEK SYSTEMS, INC. Petitioner v. ROTHSCHILD MOBILE IMAGING INNOVATIONS, LLC Patent Owner ____________________ Case No. IPR2015-00624 Patent No. 7,456,872 ____________________ PETITION FOR INTER PARTES REVIEW OF U.S. PATENT NO. 7,456,872
Transcript

Paper No. __ Filed: January 26, 2015

Filed on behalf of: Mitek Systems, Inc. By: Naveen Modi Joseph E. Palys Paul Hastings LLP 875 15th Street NW Washington, DC 20005 Telephone: (202) 551-1990 Facsimile: (202) 551-0490 E-mail: [email protected] [email protected]

UNITED STATES PATENT AND TRADEMARK OFFICE

____________________

BEFORE THE PATENT TRIAL AND APPEAL BOARD

____________________

MITEK SYSTEMS, INC.

Petitioner

v.

ROTHSCHILD MOBILE IMAGING INNOVATIONS, LLC

Patent Owner

____________________

Case No. IPR2015-00624 Patent No. 7,456,872

____________________

PETITION FOR INTER PARTES REVIEW OF U.S. PATENT NO. 7,456,872

Petition for Inter Partes Review – Patent No. 7,456,872

i

TABLE OF CONTENTS I. Introduction ...................................................................................................... 1

II. Mandatory Notices Under 37 C.F.R. § 42.8 .................................................... 1

A. Real Party-in-Interest ............................................................................ 1

B. Related Matters ...................................................................................... 1

C. Lead and Back-Up Counsel ................................................................... 2

III. Payment of Fees Under 37 C.F.R. §§ 42.15(a) and 42.103 ............................ 2

IV. Grounds for Standing ....................................................................................... 2

V. Precise Relief Requested for Each Claim Challenged .................................... 3

VI. The ’872 Patent ................................................................................................ 4

A. Overview of the ’872 Patent .................................................................. 4

B. Prosecution History of ’872 Patent ....................................................... 5

VII. Claim Construction .......................................................................................... 6

A. “user verification module” (Claim 1) .................................................... 7

VIII. The Effective Priority Date of Claims 1-39 of the ’872 Patent ....................... 8

IX. Detailed Explanation of Grounds for Unpatentability .................................. 10

A. Ground 1: Davis and Steinberg Render Claims 1-6, 9-12, 16, 18, 21-24, 27, 28, 30, 31, 34-36, 38, and 39 Obvious ......................... 10

1. Claim 1 ...................................................................................... 10

2. Claim 2 ...................................................................................... 21

3. Claim 3 ...................................................................................... 22

4. Claim 4 ...................................................................................... 23

5. Claim 5 ...................................................................................... 24

Petition for Inter Partes Review – Patent No. 7,456,872

ii

6. Claim 6 ...................................................................................... 25

7. Claim 9 ...................................................................................... 25

8. Claim 10 .................................................................................... 26

9. Claim 11 .................................................................................... 26

10. Claim 12 .................................................................................... 27

11. Claim 16 .................................................................................... 27

12. Claim 18 .................................................................................... 29

13. Claim 21 .................................................................................... 29

14. Claim 22 .................................................................................... 30

15. Claim 23 .................................................................................... 31

16. Claim 24 .................................................................................... 31

17. Claim 27 .................................................................................... 32

18. Claim 28 .................................................................................... 35

19. Claim 30 .................................................................................... 35

20. Claim 31 .................................................................................... 36

21. Claim 34 .................................................................................... 36

22. Claim 35 .................................................................................... 38

23. Claim 36 .................................................................................... 38

24. Claim 38 .................................................................................... 40

25. Claim 39 .................................................................................... 40

B. Ground 2: Davis, Steinberg, and Steinberg ’902 Render Claims 7, 13, 25, 26, and 29 Obvious .............................................................. 40

1. Claim 7 ...................................................................................... 40

Petition for Inter Partes Review – Patent No. 7,456,872

iii

2. Claim 13 .................................................................................... 42

3. Claim 25 .................................................................................... 44

4. Claim 26 .................................................................................... 45

5. Claim 29 .................................................................................... 46

C. Ground 3: Davis, Steinberg, and Terp Render Claim 14 Obvious ............................................................................................... 46

1. Claim 14 .................................................................................... 46

D. Ground 4: Davis, Steinberg, and Fukunaga Render Claims 15, 19, 20, and 32 Obvious ........................................................................ 49

1. Claim 15 .................................................................................... 49

2. Claim 19 .................................................................................... 52

3. Claim 20 .................................................................................... 53

4. Claim 32 .................................................................................... 54

E. Ground 5: Davis, Steinberg, and Knowles Render Claims 8, 17, and 33 Obvious .................................................................................... 54

1. Claim 8 ...................................................................................... 54

2. Claim 17 .................................................................................... 57

3. Claim 33 .................................................................................... 58

F. Ground 6: Davis, Steinberg, and Dodge Render Claim 37 Obvious ............................................................................................... 58

1. Claim 37 .................................................................................... 58

X. Conclusion ..................................................................................................... 60

Petition for Inter Partes Review – Patent No. 7,456,872

iv

TABLE OF AUTHORITIES

Page(s)

FEDERAL CASES

KSR Int’l Co. v. Teleflex, Inc, 550 U.S. 398, 417 (2007) .............................................................................passim Lizardtech, Inc. v. Earth Resource Mapping, Inc., 424 F.3d 1336 (Fed. Cir. 2005) ............................................................................ 9 Lockwood v. Am. Airlines, Inc., 107 F.3d 1565 (Fed. Cir. 1997) ............................................................................ 8 FEDERAL STATUTES

35 U.S.C. § 102 ...................................................................................................... 3, 4 35 U.S.C. § 103 .......................................................................................................... 3 FEDERAL REGULATIONS

37 C.F.R. § 42.8 ......................................................................................................... 1 37 C.F.R. § 42.15(a) ................................................................................................... 2 37 C.F.R. § 42.103 ..................................................................................................... 2 37 C.F.R. § 42.104(a) ................................................................................................. 2 42 C.F.R. § 42.300(b) ................................................................................................ 6

Petition for Inter Partes Review – Patent No. 7,456,872

v

LIST OF EXHIBITS1

1001 U.S. Patent No. 7,456,872 (“the ’872 Patent”)

1002 File History of the ’872 Patent

1003 U.S. Patent Application Pub. No. 2002/0001395 to Davis et al. (“Davis”)

1004 U.S. Patent No. 6,433,818 to Steinberg et al. (“Steinberg”)

1005 U.S. Patent No. 6,750,902 to Steinberg et al. (“Steinberg ’902”)

1006 Int’l Pub. No. WO/2001/31546 to Terp et al. (“Terp”)

1007 U.S. Patent No. 7,502,133 to Fukunaga et al. (“Fukunaga”)

1008 U.S. Patent No. 7,173,651 to Knowles (“Knowles”)

1009 U.S. Patent No. 7,266,544 to Dodge et al. (“Dodge”)

1010 U.S. Patent Application Pub. No. 2006/0114514 to Leigh Rothschild

1011 U.S. Patent No. 7,450,163 (“the ’163 Patent”)

1012 Declaration of Dr. Irfan Essa

1 Citations to non-patent publications are to the page numbers of the publication

and citations to patent publications are to column:line number of the patents.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

1

I. Introduction

Mitek Systems, Inc. (“Petitioner”) requests inter partes review of claims 1-

39 of U.S. Patent No. 7,456,872 (“the ’872 Patent”) (Ex. 1001). This Petition

shows, by a preponderance of the evidence, that there is a reasonable likelihood

that Petitioner will prevail on claims 1-39 of the ’872 Patent based on prior art that

the U.S. Patent Office (“PTO”) did not have before it during prosecution, and that

renders obvious the claims of the ’872 Patent. Claims 1-39 of the ’872 Patent

should be found unpatentable and canceled.

II. Mandatory Notices Under 37 C.F.R. § 42.8

A. Real Party-in-Interest

Pursuant to 37 C.F.R. § 42.8(b)(1), Petitioner identifies Mitek Systems, Inc.

as the real party-in-interest.

B. Related Matters

In accordance with 37 C.F.R. § 42.8(b)(2), Petitioner identifies the following

related matters. The Patent Owner asserted the ’872 Patent against Mitek Systems,

Inc., JPMorgan Chase & Co, and JPMorgan Chase Bank, N.A. in a patent litigation

filed on May 16, 2014, in the District of Delaware (case no. 1:14-cv-00617). On

September 8, 2014, the Patent Owner initiated three additional patent litigation

actions in the District of Delaware, asserting the ’872 Patent against the following

parties: (1) Mitek Systems, Inc., Bank of America Corporation, and Bank of

America, N.A. (case no. 1:14-cv-01142); (2) Mitek Systems, Inc., Citigroup Inc.,

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

2

and Citibank, N.A. (case no. 1:14-cv-01143); and (3) Mitek Systems, Inc., Wells

Fargo & Company, and Wells Fargo Bank, N.A. (case no. 1:14-cv-01144). These

four actions are currently pending. Petitioner is also filing concurrently herewith

petitions for inter partes review of related U.S. Patent Nos. 7,450,163, 7,991,792,

and 7,995,118.

C. Lead and Back-Up Counsel

Lead counsel is Naveen Modi (Reg. No. 46,224), Paul Hastings LLP, 875

15th St. N.W., Washington, D.C., 20005, Telephone: 202.551.1700, Fax:

202.551.1705, Email: [email protected]; and Backup counsel is

Joseph E. Palys (Reg. No. 46,508), Paul Hastings LLP, 875 15th St. N.W.,

Washington, D.C., 20005, Telephone: 202.551.1700, Fax: 202.551.1705, Email:

[email protected].

III. Payment of Fees Under 37 C.F.R. §§ 42.15(a) and 42.103

The required fees are submitted herewith. The PTO is authorized to charge

any additional fees due at any time during this proceeding to Deposit Account No.

50-2613.

IV. Grounds for Standing

Petitioner certifies that, under 37 C.F.R. § 42.104(a), the ’872 Patent is

available for inter partes review, and that Petitioner is not barred or estopped from

requesting inter partes review of the ’872 Patent on the grounds identified.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

3

V. Precise Relief Requested for Each Claim Challenged

Petitioner challenges claims 1-39 of the ’872 Patent and requests that these

claims be found unpatentable and canceled in view of the following prior art: U.S.

Patent Application Pub. No. 2002/0001395 to Davis et al. (“Davis”) (Ex. 1003);

U.S. Patent No. 6,433,818 to Steinberg et al. (“Steinberg”) (Ex. 1004); U.S. Patent

No. 6,750,902 to Steinberg et al. (“Steinberg ’902”) (Ex. 1005); Int’l Pub. No.

WO/2001/31546 to Terp et al. (“Terp”) (Ex. 1006); U.S. Patent No. 7,502,133 to

Fukunaga et al. (“Fukunaga”) (Ex. 1007); U.S. Patent No. 7,173,651 to Knowles

(“Knowles”) (Ex. 1008); U.S. Patent No. 7,266,544 to Dodge et al. (“Dodge”) (Ex.

1009). Petitioner requests cancellation of claims 1-39 on the following grounds:

Ground 1: Claims 1-6, 9-12, 16, 18, 21-24, 27, 28, 30, 31, 34-36, 38, and 39

are obvious under pre-AIA 35 U.S.C. § 103(a) over Davis and Steinberg;

Ground 2: Claims 7, 13, 25, 26, and 29 are obvious under pre-AIA 35 U.S.C. §

103(a) over Davis, Steinberg, and Steinberg ’902; Ground 3: Claim 14 is obvious

under pre-AIA 35 U.S.C. § 103(a) over Davis, Steinberg, and Terp; Ground 4:

Claims 15, 19, 20, and 32 are obvious under pre-AIA 35 U.S.C. § 103(a) over

Davis, Steinberg, and Fukunaga; Ground 5: Claims 8, 17, and 33 are obvious

under pre-AIA 35 U.S.C. § 103(a) over Davis, Steinberg, and Knowles; and

Ground 6: Claim 37 is obvious under pre-AIA 35 U.S.C. § 103(a) over Davis,

Steinberg, and Dodge.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

4

As explained below in Section VIII, for purposes of this proceeding, the

effective filing date of claims 1-39 of the ’872 Patent is February 4, 2005. Davis,

Steinberg, and Terp published more than one year prior to the effective filing date

of the ’872 Patent and thus are prior art under pre-AIA 35 U.S.C. § 102(b).

Steinberg ’902 published prior to the effective filing date of the ’872 Patent and is

prior art to the patent under pre-AIA 35 U.S.C. § 102(a). Steinberg ’902,

Fukunaga, Knowles, and Dodge were filed prior to the effective filing date of the

’872 Patent and are prior art under pre-AIA 35 U.S.C. § 102(e).

VI. The ’872 Patent

A. Overview of the ’872 Patent

The ’872 Patent, entitled “Device and Method for Embedding and

Retrieving Information in Digital Images,” issued on November 25, 2008, from

U.S. Application No. 11/051,069 (filed February 4, 2005). Ex. 1001. The ’872

Patent is a continuation-in-part of U.S. Application No. 11/020,459 (“the ’459

Application”), filed on December 22, 2004, and published as U.S. Patent

Application Pub. No. 2006/0114514. Ex. 1010. The ’459 Application is a

continuation-in-part of U.S. Application No. 10/998,691, filed on November 29,

2004, and issued as U.S. Patent No. 7,450,163 (“the ’163 Patent”). Ex. 1011.

The ’872 Patent purportedly introduces a locational image verification

device (“LIVD”) that receives an assignment to be completed by the user of the

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

5

LIVD. Ex. 1001, 13:49 - 14:29. According to the patent, an assignment may be

one that instructs a user to visit “specific locations … with tasks associated with

each location.” Id., 13:62-66. “When the user arrives at his specific assignment,

he may use the [LIVD] to verify and capture information [related to the task].” Id.,

14:21-22. Accordingly, the LIVD captures images, as well as other information,

such as location, time, and date, related to the task. See, e.g., id., 14:39-46. Once

the information is acquired, the LIVD will associate the acquired information with

the “assignment” (see id., 14:46-49), encrypt the image and information (see id.,

14:50-64), and transmit the encrypted image and information to a remote location

(see id., 14:65-15:26). However, as explained below, the techniques and processes

disclosed in the specification and recited in claims 1-39 of the ’872 Patent describe

nothing more than conventional features for capturing images relating to

assignments. See also Ex. 1012, ¶¶ 8, 10, 13-29.

B. Prosecution History of ’872 Patent

During prosecution, all of the claims of U.S. Application No. 11/051,069

that eventually issued as the ’872 Patent were initially rejected as unpatentable

over the prior art. See Ex. 1002, pp. 87-104. In response, claim 30 of the

application (which presently corresponds to claim 1 of the ’872 Patent) was

amended to recite a combination of well-known features relating to user

verification, date and time, assignment, user identity, and encryption. Id., p. 117.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

6

According to the Applicant, the claims were patentable because they were directed

to “information associated with the images [that] can be used to verify the images

as genuine and that the images have not been tampered with by the user of the

device.” Id., p. 124. In response to the Applicant’s representations, the PTO

subsequently indicated that the pending claims were allowable. Id., pp. 132, 165.

However, prior art identified in this petition disclose precisely the same features as

those highlighted by the Applicant as being critical to the ’872 Patent and was

never made of record, and thus not considered by the PTO. See, e.g., Ex. 1003, ¶¶

[0103], [0201]-[0205] (verifying that images are genuine and “not tampered

with”); see also Ex. 1001.

VII. Claim Construction

A claim of an unexpired patent subject to inter partes review receives the

“broadest reasonable construction in light of the specification of the patent in

which it appears.” 42 C.F.R. § 42.300(b). The ’872 Patent has not expired. Thus,

for purposes of this proceeding, the claims of the ’872 Patent should be given their

broadest reasonable construction. Petitioner presents below proposed

constructions for certain claim terms. Any term not construed herein should be

interpreted in accordance with its plain and ordinary meaning under the broadest

reasonable construction. Petitioner applies this understanding in the analysis of

claims 1-39 and the prior art below. Given the different claim construction

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

7

standards used by the PTO and district courts, Petitioner expressly reserves the

right to argue a different construction for any term during litigation. See also Ex.

1012, ¶¶ 10-12.

A. “user verification module” (Claim 1)

Claim 1 recites a “user verification module for verifying an identity of a user

of the device, wherein upon verification . . . enables operation of the device and

provides an assignment to the user.” Ex. 1001, 16:58-61. The specification of the

’872 Patent describes a user verification module (“UVM” 132) that will “verify the

identity of the user of the device 100 at the time of image capture.” Id., 5:26-28.

See also id., 5:44-51, 13:49-57, 14:8-13, 14:30-32. However, the specification

does not provide any disclosure of a user verification module that provides an

assignment to the user. In all instances regarding an assignment, the specification

refers to other features of device 100. See e.g., id., 13:58-62 (referring to

transmission module 112), 13:66-14:1 (referring to user input module 124), 14:14-

15 (referring to locational informational module 134), 14:15-17 (referring to

storage module 110), 15:11-26 (describing how record 630 include information for

verifying an assignment, and not providing the assignment to a user). Moreover,

this feature of the “user verification module” recited in claim 1 was added during

prosecution, and thus was not part of the application as originally filed. See, e.g.,

Ex. 1002, p. 117. While Petitioner cannot address the merits of this issue in this

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

8

inter partes review proceeding,2 for purposes of applying the prior art, and given

the language of claim 1, the term “user verification module” in claim 1 should be

interpreted in this proceeding so as not to limit the module to one that only

performs verification of a user and enables operation of the device upon

verification, like that described in the specification, but one that can also perform

other features, such as providing an assignment to a user like that recited in claim

1. Thus, a prior art disclosure of one or more devices, components, modules,

systems, or the like that can perform user verification features like those recited in

claim 1, and perform other features, including providing an assignment to a user,

would meet the “user verification module” limitations of claim 1. Petitioner

applies this understanding in applying the prior art to this limitation. Ex. 1012, ¶

12.

VIII. The Effective Priority Date of Claims 1-39 of the ’872 Patent

The Board may consider priority in inter partes review proceedings. See,

e.g., SAP Am., Inc. v. Pi-Net Int’l, Inc., IPR2014-00414, Paper No. 11 at 11-16

(Aug. 18, 2014). Under 35 U.S.C. § 120, a claim in a U.S. application is entitled to

the benefit of the filing date of an earlier filed U.S. application if the subject matter

of the claim is disclosed in the earlier filed application in accordance with the

written description requirement. See, e.g., id.; Lockwood v. Am. Airlines, Inc., 107

2 See 35 U.S.C. § 311(b).

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

9

F.3d 1565, 1571 (Fed. Cir. 1997). To comply with the requirement of 35 U.S.C. §

112, first paragraph, the specification “must describe the invention sufficiently to

convey to a person of skill in the art that the patentee had possession of the claimed

invention at the time of the application, i.e., that the patentee invented what is

claimed.” Lizardtech, Inc. v. Earth Resource Mapping, Inc., 424 F.3d 1336, 1345

(Fed Cir. 2005).

The ’872 Patent claims priority to several earlier filed applications. See Ex.

1001, 1:8-17; see also supra Section VI.A. The earlier applications and the ’163

Patent that issued from the earliest of these applications do not disclose the

“assignment” limitation of claims 1 and 27 of the ’872 Patent. See Exs. 1010,

1011 (which respectively show the specifications filed for application nos.

11/020,459 and 10/998,691) . Rather, this limitation was at best first disclosed in

the application that issued into the ’872 Patent. Compare Ex. 1002, pp. 16, 40-46,

Fig. 8, with Exs. 1010 and 1011 (wherein Figure 8 and the associated text of the

’872 Patent, describing the “assignment” limitation, are not present in the earlier

filed applications). Ex. 1012, ¶ 9. Because the earlier filed applications lack

written description support for claims 1 and 27, the earliest possible priority date

for these claims is the February 4, 2005 filing date of the ’872 Patent. In addition,

the earlier filed applications lack written description support for dependent claims

2-26 and 28-39 at least because these claims depend from claims 1 or 27.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

10

Accordingly, the earliest possible priority date for the ’872 Patent’s dependent

claims is also February 4, 2005.

IX. Detailed Explanation of Grounds for Unpatentability

A. Ground 1: Davis and Steinberg Render Claims 1-6, 9-12, 16, 18, 21-24, 27, 28, 30, 31, 34-36, 38, and 39 Obvious

With respect to all of the claimed modules in the claims of the ’872 patent,

including the “user verification module,” Davis discloses that the functions of its

digital camera may be implemented using one or more components (which alone

or collectively form a module depending on their disclosed contribution to the

disclosed functions), such as application programs executed on a processing unit

such as a microprocessor or DSP. See, e.g., Ex. 1003, ¶¶ [0035]-[0037], [0082]-

[0083]. Thus, all of the functions of Davis’s camera are performed using

respective modules. For example, one function of Davis’s digital camera that

would thus be implemented using an application program executed by a processing

unit obtains the identity of a user of the camera. See id., ¶¶ [0060]-[0061], [0108];

see also Ex. 1012, ¶¶ 18, 33.

1. Claim 1

a) “A locational image verification device for verifying an assignment of a user comprising:”

Davis discloses a “locational image verification device for verifying an

assignment of a user,” such as a digital camera that may be used by a photographer

whose supervisor provides operating parameters that define a session (e.g., an

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

11

assignment). See Ex. 1003, ¶¶ [0032]-[0043], [0065]-[0066], Fig. 1. As one

example, a session (e.g., an assignment) for capturing an image may be defined

“for selected GPS locations within a defined range,” and the user may be

disallowed from capturing images when the camera travels outside a particular

geographic location specified in the session parameters. See id., ¶¶ [0068]-[0069].

Similarly, the session parameters can also selectively allow certain actions within a

given area. Id., ¶ [0069]. See also citations and analysis below for claim elements

1(b)-(g). Ex. 1012, ¶ 30.

b) “a user verification module for verifying an identity of a user of the device, wherein upon verification, the user verification module enables operation of the device and provides an assignment to the user;”

Davis and Steinberg disclose these limitations. For example, one function of

Davis’s digital camera that would be implemented using an application program

executed by a processing unit obtains the identity of a user of the camera. See id.,

¶¶ [0060]-[0061], [0108]. In addition, Davis discloses a user verification function

that may be performed at a server to enable an editing operation. See, e.g., Ex.

1003, ¶ [0157]. See also Ex. 1012, ¶¶ 33, 34. As described above, such functions

are performed by one or more components that form a module to perform such

functions. See also id., ¶¶ 18, 33. Davis does not explicitly disclose “a user

verification module for verifying an identity of a user of the device, wherein upon

verification, the user verification module enables operation of the device and

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

12

provides an assignment to the user.” However, it would have been obvious to a

person of skill in the art at the time of the alleged invention of the ’872 Patent to

include this feature in the digital camera described in Davis based on the

knowledge of a person of ordinary skill in the art and the disclosure of Steinberg.

Ex. 1004; Ex. 1012, ¶ 34.

Steinberg discloses a digital camera that obtains and verifies the identity of a

user of the camera. See Ex. 1004, 5:35-52, 7:5-51, Fig. 8; Ex. 1012, ¶ 35. For

example, in Steinberg, an “authorized user” will initially “present[] a

password/key,” which enables a biometric data storing operation of the camera, as

well as other operations of the camera such as “access [to] the camera

programmability.” . See Ex. 1004, 4:12-33, 5:60-62, 7:6-9, Fig. 8; Ex. 1012, ¶¶

35, 36 (discussing Demonstrative A). As shown in Figure 8, after a password/key

associated with an authorized user is entered, the user places his eye through the

camera view finder, and/or places his finger on the shutter/activate button and the

camera in response takes the biometric data, and processes and stores it as

signature data. See id., 6:5-10; Ex. 1012, ¶ 36. The password/key check of

Steinberg represents a first user verification operation. See Ex. 1012, ¶ 37. The

digital camera in Steinberg performs another user verification operation at a time

of image capture, comparing the biometric data (e.g., iris or fingerprint data)

acquired when the password/key was provided by the user to biometric data

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

13

captured when the user “presses the activation/shutter button.” See Ex. 1004, 5:43-

52, 7:19-51, Fig. 7; see also Ex. 1012, ¶ 37. As shown in Figure 7, after a user

initiates taking a picture, biometric data will be collected and compared to stored

biometric data, and a picture will be taken if there is a match between the two sets

of biometric data. Ex. 1004, 5:50-52, 7:42-43; Ex. 1012, ¶ 37. The “camera does

not take a picture” if there is no match with the biometric data comparison. Ex.

1004, 5:48-50, 7:49-51.

It would have been obvious to one of ordinary skill in the art at the time of

the alleged invention of the ’872 Patent to modify the camera disclosed in Davis to

include, in one of its applications executed on a processing unit, a user verification

module that verifies an identity of a user of the device, e.g., with a password or

biometric check, as disclosed in Steinberg. See Ex. 1012, ¶ 38. Moreover, as also

disclosed in Steinberg, one of ordinary skill in the art would have recognized that

such a user verification check could easily be used to enable operation of a device

and enable providing of data, such as an assignment, to the user. Id. Steinberg,

which implements such user verification functionality to “eliminate[e]

unauthorized use of a camera,” directly supports Davis’s stated goal of

“intentionally preclud[ing]” photographers “from controlling the data associated

with pictures” where “there is concern that the photographer might tamper with the

metadata associated with an image.” See Ex. 1004, 1:12-16; Ex. 1003, ¶ [0065];

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

14

Id. Thus, one of ordinary skill in the art at the time of the alleged invention would

have turned to the teachings of Steinberg to improve Davis’s camera. Moreover, it

would have been common sense to one of ordinary skill to utilize such user

verification prior to initiating a session (e.g., providing an assignment to capture

images of “selected GPS locations”) and prior to capturing the images. Id.; see

also Ex. 1003, ¶¶ [0065]-[0069]. Given that Davis and Steinberg disclose image

capture systems and processes, it would have been trivial to add the user

verification functionality of Steinberg to Davis, and given that Steinberg and Davis

both attempt to solve a similar problem, one of ordinary skill in the art would have

found implementing such a modification to be common sense, predictable, and

within the realm of knowledge of one skilled in the art at the time of the alleged

invention. See KSR Int’l Co. v. Teleflex, Inc., 550 U.S. 398, 417 (2007); Ex. 1012,

¶ 38.

c) “a capture module for capturing an image relating to the assignment and creating a digital image file, wherein the user verification module verifies the identity of the user of the device at a time of the image capture”

Davis and Steinberg disclose these limitations. Davis’s camera includes a

capture module comprising “an optical system 14, an image sensor 16, and an

image formatter 18.” See Ex. 1003, ¶ [0034]. The optical system 14 “control[s]

the transfer of light to the camera’s sensor 16.” Id. The image formatter 18

“transforms the image signal into a form suitable for further processing and storage

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

15

and stores it in the camera’s memory subsystem.” Id. Digital image files that are

created by the camera include two components. In particular, a given image file

will include both an “image” portion containing the image itself (and, as discussed

in more detail below, a watermark embedded into the image) and a metadata

contained, for example, in the “file header.” Id., ¶¶ [0026], [0101]. The capture

module is used in Davis, for example, to capture images defined by the operating

parameters of the session (e.g., the assignment). Id., ¶ [0068]; Ex. 1012, ¶ 39. For

example, images of “selected GPS locations” defined by the session’s operating

parameters may be captured by the capture module. Ex. 1003, ¶ [0068].

Therefore, the components of Davis’s camera include a capture module for

capturing an image relating to the assignment and creating a digital image file.

While Davis does not explicitly disclose that “the user verification module verifies

the identity of the user of the device at a time of the image capture,” it would have

been obvious to a person of skill in the art at the time of the alleged invention of

the ’872 Patent to include this feature based on the knowledge of a person of

ordinary skill in the art and the disclosure of Steinberg. Ex. 1004; Ex. 1012, ¶ 40.

For example, as discussed above for claim element 1(b), the digital camera

in Steinberg performs a user verification operation at a time of image capture,

comparing biometric data (e.g., iris or fingerprint data) previously provided by a

user to biometric data captured when the user “presses the activation/shutter

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

16

button” of the camera. See Ex. 1004, 5:43-52, 7:19-51, Fig. 7; Ex. 1012, ¶ 41

(discussing Demonstrative C). The “camera does not take a picture” if there is no

match with the biometric data comparison. Id.; see also analysis and citations

above for claim element 1(b). The user verification (i.e., the biometric data

comparison) occurs during the time of image capture. Ex. 1004, Fig. 7. The time

of image capture begins when the user “initiate[s] taking a picture” and ends when

the “camera proceeds to take a picture,” with the biometric data comparison (e.g.,

“is prospective user data a match with signature?”) occurring in between both

events. See, e.g., id., Figs. 7, 10; Ex. 1012, ¶ 41.

It would have been obvious to one of ordinary skill in the art at the time of

the alleged invention of the ’872 Patent to modify the camera disclosed in Davis to

include, in one of its modules executed on a processing unit, a user verification

module that verifies an identity of a user of the device at a time of the image

capture, as disclosed in Steinberg to ensure only authorized users operate the

camera device. Ex. 1012, ¶ 42. Steinberg, which implements such user

verification functionality to “eliminate[e] unauthorized use of a camera,” directly

supports Davis’s stated goal of “intentionally preclud[ing]” photographers “from

controlling the data associated with pictures” where “there is concern that the

photographer might tamper with the metadata associated with an image.” See Ex.

1004, 1:12-16; Ex. 1003, ¶ [0065]; Ex. 1012, ¶ 42. Thus, one of ordinary skill in

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

17

the art at the time of the alleged invention would have turned to the teachings of

Steinberg to enhance the features of Davis’s camera. Ex. 1012, ¶ 42. Moreover, it

would have been common sense to one of ordinary skill in the art to utilize such

user verification prior to capturing images. Id.; Ex. 1003, ¶¶ [0065]-[0069]. Given

that Davis and Steinberg disclose image capture systems and processes, it would

have been trivial to add the user verification functionality of Steinberg to Davis,

and given that Steinberg and Davis both attempt to solve a similar problem, one of

ordinary skill in the art would have found implementing such a modification to be

common sense, predictable, and within the realm of knowledge of one skilled in

the art at the time of the alleged invention. See KSR Int’l Co., 550 U.S. at 417

(2007); Ex. 1012, ¶ 42.

d) “a locational information module for determining a location of the device when capturing the image;”

Davis discloses these limitations. For example, Davis’s digital camera

includes a GPS to determine the location of the camera. See, e.g., Ex. 1003, ¶

[0060]. One of the functions performed by the camera is to record a location of the

camera, “as determined by the GPS unit within the device,” when capturing an

image. See id., ¶¶ [0067]-[0070]; see also id., ¶¶ [0107], [0110] (one type of data

that can be associated with a captured image includes “where was the picture taken

. . . provided by [the] GPS device”). The components that perform the above

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

18

described functions reflect a locational information module as recited in this claim.

Ex. 1012, ¶ 43.

e) “a date and time module for determining a date and time of the image capture;”

Davis discloses these limitations. See Ex. 1012, ¶ 44. For example, one of

the functions performed by the camera is to record a “time” and “date” of an image

capture using, for example, a clock. See Ex. 1003, ¶¶ [0060] (disclosing that the

digital camera includes a “clock”), [0067]-[0070] (capturing “time, date”

information), [0107], [0111] (one type of data that can be associated with a

captured image includes “when was the picture taken (e.g., date and time of

date)”). The components of the camera that perform the above described functions

reflect a date and time module as recited in this claim. Ex. 1012, ¶ 44.

f) “a processing module for associating the assignment, the user identity, location information and the time and date to the digital image file; and”

Davis discloses these limitations. See Ex. 1012, ¶ __. For example, the

digital camera of Davis includes a “steganographic embedder . . . implemented as

an application program that executes on the processing unit.” See Ex. 1003, ¶¶

[0037], [0095]. The steganographic embedder is used to associate a time, date, and

place, to a digital image file. See id., ¶¶ [0067]-[0070], [0107], [0110]-[0111].

The steganographic embedder is also used to associate a user identity to the digital

image file. See id., ¶¶ [0060], [0107]-[0108]. Moreover, Davis discloses that the

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

19

session (i.e., the assignment) may be tracked and associated with the other session

related metadata (e.g., time, date, place, and user identity) “by a session identifier

encoded in the image, the image file, or its metadata.” Id., ¶ [0071]. The session

identifier may be, for example, “a number or message embedded

steganographically in the image or metadata associated with the image.” Id.; see

also id., ¶¶ [0114] (recording “why was the picture taken”), [0120] (recording

“picture identifiers”), [0121] (recording “collection data, including collection ID”).

Ex. 1012, ¶ 45.

The steganographic embedder implements the association by, for example,

“convert[ing] [the] auxiliary data to be embedded in the image,” such as the

assignment, the user identity, location information and the time and date, “into [a]

watermark signal and combin[ing] the watermark signal with the image.” Id., ¶¶

[0095]-[0096]. For example, when an image is being encoded, one option is for

“the encoder [to] retrieve[] data designated for embedding in the image, [to]

convert it into a watermark signal and [to] combine[] it with the associated image.”

Id., ¶ [0097]. Therefore, the components that perform the above described

functions, such as the steganographic embedder that associates the assignment, the

user identity, location information and the time and date to the digital image file,

reflect the processing module recited in this claim. See Ex. 1012, ¶ 45.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

20

The association of the assignment, the user identity, location information

and the time and date to the digital image file, is also implemented in additional

ways. For example, “[t]he camera . . . may also embed auxiliary data in the image

file, but outside the image,” by storing metadata in “the file header.” See Ex. 1003,

¶ [0101]. “[A] reference embedded in the image can be used to correlate the image

with the correct metadata.” Id., ¶ [0102]. As another example, “the auxiliary data

associated with the image can be maintained separately from the image,” with “[a]

reference to this external, auxiliary data . . . embedded in the image (e.g., in a

watermark), in the image file metadata, or both.” Id., ¶ [0105]. These additional

association functions of Davis would be implemented using an application

program executed on a processing unit such as a microprocessor or DSP of the

digital camera, and thus would be implemented by a processing module. See, e.g.,

id., ¶¶ [0035]-[0037], [0082]-[0083]; Ex. 1012, ¶ 46. Thus, the components that

perform these additional functions may also reflect the processing module recited

in this claim. Ex. 1012, ¶ 46.

g) “an encryption module for encrypting the digital image file and associated information upon image capture.”

Davis discloses these limitations. For example, Davis discloses that after its

digital camera generates a digital image file and associated information (e.g., time,

date, place, user identity, and session identifier), one function of the camera will

encrypt both the digital image and the associated information. See Ex. 1003, ¶

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

21

[0103]. In particular, Davis discloses that a number that is a “digital signature

derived from the image, such as by performing a hash function on the image

sample values,” can be encrypted, and that the watermark constructed to contain

the associated information can also be encrypted. See id., ¶ [0103]; see also id., ¶¶

[0133] (describing that both “the image, and the image data,” can be encrypted),

[0169] (“One way to secure the metadata is to encrypt it”), [0194] (“the metadata

may be encrypted and inserted into a watermark in the media signal”), [0200]-

[0203]. Ex. 1013, ¶ 47. Davis discloses that this encryption can occur “at or

shortly after image capture in the camera.” See id., ¶ [0169]; see also Ex. 1012, ¶

47. This encryption function would be implemented using an application program

executed on a processing unit such as a microprocessor or DSP of the digital

camera, and thus would be implemented by an encryption module. See, e.g., Ex.

1003, ¶¶ [0035]-[0037], [0082]-[0083]. Thus, the components that perform the

above described functions reflect an encryption module as recited in this claim.

Ex. 1012, ¶ 47.

2. Claim 2

a) “The device as in claim 1, further comprising a microphone for acquiring audio to be associated to the digital image file.”

Davis discloses these limitations. For example, Davis discloses that its

digital camera “may also be configured to receive voice input through a

microphone, voice codec, and voice recognition hardware and software.” Ex.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

22

1003, ¶ [0058]. The voice input is associated to the digital image file in the same

manner as the other types of data described above with respect to claim 1. See,

e.g., id., ¶¶ [0125] (“Sound annotation” is associated to the image file), [0198]

(“As part of the embedding process, a sound (such as a voice instruction or

comment) can be compressed and embedded into the image’s watermark”). See

also Ex. 1012, ¶ 49.

3. Claim 3

a) “The device as in claim 1, further comprising a display module for displaying the captured image.”

Davis and Steinberg disclose these limitations. For example, the digital

camera of Davis has a module that includes display 24 and display screen 36. Ex.

1003, ¶ [0039], Fig. 1; see also id., ¶ [0059] (“the camera may have a display

screen, with . . . support for video output”). While Davis’s display module “may

produce visual . . . output,” (see id., ¶ [0059]), Davis does not explicitly disclose

that the display module is used to display the captured image. However, one of

ordinary skill in the art would have found it obvious to configure the display

module to perform this intended use given the knowledge of a person of ordinary

skill in the art and the disclosure of Davis and Steinberg. Ex. 1012, ¶50.

Davis already discloses that its display module is capable of producing

visual output, including video output, and thus is capable of displaying a captured

image. See Ex. 1003, ¶¶ [0039], [0059]; Ex. 1012, ¶ 51. As such, it would have

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

23

been a predictable and commonsense implementation and a simple design choice

for the digital camera of Davis to display a captured image so that a user can view

captured and retrieved images. See, e.g., Ex. 1004, 3:64-64 (the “specific items

displayed [on a display] are a matter of design choice”). Indeed, the device of

Davis may be a conventional digital camera, which is widely known to display

captured images, particularly when already including a display. See Ex. 1012, ¶

51. Therefore, one of ordinary skill in the art would have found that displaying a

captured image on the display module of Davis’s camera to be a commonsense and

predictable design choice, within the realm of knowledge of one skilled in the art at

the time of the alleged invention. See KSR Int’l Co., 550 U.S. at 417 (2007); Ex.

1012, ¶ 51.

4. Claim 4

a) “The device as in claim 3, wherein the display module is adapted to prompt a user to input information regarding the captured image.”

Davis discloses these limitations. For example, Davis discloses that “the

user may [] specify actual data items to be associated with images . . . through the

user interface of the image capture device.” Ex. 1003, ¶¶ [0029], [0060]. “Using

known UI techniques, the user can use the scroll buttons 38-44 to scroll through a

list of selections displayed on display screen 36 until a desired selection is

presented.” Id., ¶ [0061]. “Once the list has been scrolled to the desired entry, the

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

24

user can actuate a second button (e.g., 32-34) to effect that selection,” wherein the

“data types associated with an image or set of images can be of various classes”

such as “the subject” of an image. Id.; see also id., ¶ [0063] (“The class of subjects

can . . . include a default list (e.g., Birthday, Vacation, Anniversary, Wedding,

House, Car, Pet, etc.) and/or a customized list (Uncle Harry, Yellowstone,

Mushrooms, Seascapes, etc.)”). “A descriptor selected by the user can be used to

encode the picture just-snapped, or can be used to encode pictures thereafter-

snapped.” Id., ¶ [0063]. Therefore, by presenting a “list of selections” for the user

to scroll through, input, and associate with an image, the display module of Davis’s

digital camera prompts the user to input information regarding the captured image.

See also Ex. 1012, ¶ 52.

5. Claim 5

a) “The device as in claim 4, further comprising a character recognition capture device coupled to the input module for entering information regarding the capture images.”

Davis discloses these limitations. For example, Davis discloses that the

input devices used to enter the information regarding the captured images can

include “touch screens, soft buttons, scroll bars, and check boxes displayed on a

display device.” Ex. 1003, ¶ [0058]. The camera may also “support one or more

plug-in user interface peripherals, such as a keyboard.” Id., ¶ [0064]. One skilled

in the art would have realized based on the disclosure of Davis that these devices

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

25

allow for the entering of information regarding the captured images. See, e.g., id.,

¶¶ [0060]-[0063]; Ex. 1012, ¶ 53.

6. Claim 6

a) “The device as in claim 5, wherein the character recognition device is a touch screen overlaid upon the display module.”

Davis discloses these limitations. For example, as discussed above with

respect to claim 5, Davis discloses that the input components used to enter the

information regarding the captured images can include “touch screens, soft

buttons, scroll bars, and check boxes displayed on a display device.” Ex. 1003, ¶

[0058]. Such touchscreen components were known to overlay on a display

component, such as the display module described above in connection with claim

3. See Part IX.A.3. Ex. 1012, ¶ 54. As such, Davis necessarily discloses a touch

screen that is overlaid upon the display module because without such a

configuration, the touch screen features disclosed by Davis would not be

performed. Thus, such a component and arrangement must be present. Ex. 1012, ¶

54.

7. Claim 9

a) “The device as in claim 1, further comprising a storage module for storing at least one digital image file and the information associated to the digital image file.”

Davis discloses these limitations. For example, Davis discloses that the

digital camera includes a “memory subsystem 20 [that] includes a combination of

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

26

ROM, RAM, and removable storage devices such as a flash memory card.” Ex.

1003, ¶ [0038]. The memory subsystem 20 of Davis is used to store the digital

image files and associated information described above in connection with claim 1.

Id., ¶¶ [0034], [0087], [0096]-[0097]; see also analysis and citations regarding

these limitations for claim 1 in Parts IX.A.1; Ex. 1012, ¶ 55.

8. Claim 10

a) “The device as in claim 9, wherein the storage module is internal storage memory or removable storage memory.”

Davis discloses these limitations. For example, Davis discloses that the

digital camera includes a “memory subsystem 20 [that] includes a combination of

ROM, RAM, and removable storage devices such as a flash memory card.” Ex.

1003, ¶ [0038], analysis and citations above for claim 9, Ex. 1012, ¶ 56.

9. Claim 11

a) “The device as in claim 1, further comprising a transmission module for transmitting at least one digital image file and its associated information to a computing device.”

Davis discloses these limitations. For example, Davis discloses that its

digital camera “is equipped with one or more external interfaces to transfer images,

image related data, and operating parameters to and from external devices.” Ex.

1003, ¶ [0040]; see also id., ¶¶ [0041] (disclosing “ports 50”), [0042] (disclosing

“transceivers and receivers 52 for wireless connections”), [0043] (disclosing

“cellular or conventional modem 54 for transferring data to and from a telephone

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

27

network”), [0053]-[0054] (describing how data is uploaded from the camera), Fig.

2. The components in the camera device that performs the above described

functions reflect a transmission module as recited in this claim. Ex. 1012, ¶ 57.

10. Claim 12

a) “The device as in claim 11, wherein the transmission module is a hardwired connection, a wireless connection or a removable memory card slot for receiving removable memory.”

Davis discloses these limitations. For example, Davis discloses that the

external interface discussed above with respect to claim 11 may include “ports 50

for wire connections to external devices such as serial ports, USB ports, parallel

ports, PCI, Firewire or Ilink ports,” “transceivers and receivers 52 for wireless

connections such as an infrared transceiver, RF transceivers (Bluetooth

transmitter/receivers), FM receivers,” and “cellular or conventional modem 54 for

transferring data to and from a telephone network.” Ex. 1003, ¶¶ [0040]-[0043],

Fig. 2. Moreover, “[i]n addition to transferring images and data via connections to

external devices, the camera can also receive and send data via a removable

memory device.” Id., ¶ [0043]. See also Ex. 1012, ¶ 58.

11. Claim 16

a) “The device as in claim 1, further comprising a communication module coupled to an antenna for wirelessly receiving and transmitting communication messages.”

Davis discloses these limitations. For example, Davis discloses that its

digital camera “is equipped with one or more external interfaces to transfer images,

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

28

image related data, and operating parameters to and from external devices,”

including “transceivers and receivers 52 for wireless connections such as an

infrared transceiver, RF transceivers (Bluetooth transmitter/receivers), FM

receivers,” and “cellular or conventional modem 54 for transferring data to and

from a telephone network.” Ex. 1003, ¶¶ [0040]-[0043]; see also id., ¶¶ [0049]-

[0052] (disclosing how communication messages can be wirelessly received by the

camera), [0053]-[0054] (describing how communication messages can be

wirelessly transmitted from the camera), Fig. 2. One of ordinary skill in the art

would have understood that cellular, RF, and FM transceivers, as disclosed in

Davis, would necessarily include an antenna given that without such a component,

such communication functions could not be performed. See Ex. 1012, ¶ 59.

Moreover, even if an antenna was not necessarily present in Davis’s

communication module, its inclusion would have been obvious given the

disclosure of Steinberg that antennas are used to transmit and receive data when

using wireless communication such as radio frequency (RF) communication, and

would not have affected the functionality of Davis in any way. See, e.g., Ex. 1004,

3:41-43; Ex. 1012, ¶ 60. One of ordinary skill in the art would have found

implementing such a modification to be common sense, predictable, and within the

realm of knowledge of one skilled in the art at the time of the alleged invention to

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

29

enable wireless communications like that disclosed by Davis. See KSR Int’l Co.,

550 U.S. at 417 (2007); Ex. 1012, ¶ 60.

12. Claim 18

a) “The device as in claim 16, further comprising a transmission module coupled to the antenna for transmitting at least one digital image file and its associated information to a computing device.”

Davis discloses these limitations. For example, Davis discloses that the

external interface discussed above with respect to claim 16 can “transfer images,

image related data, and operating parameters to and from external devices,” and

may include “transceivers and receivers 52 for wireless connections such as an

infrared transceiver, RF transceivers (Bluetooth transmitter/receivers), FM

receivers,” and “cellular or conventional modem 54 for transferring data to and

from a telephone network.” Ex. 1003, ¶¶ [0040]-[0043]; see also id., ¶¶ [0049]-

[0052] (disclosing how communication messages can be wirelessly received by the

camera), [0053]-[0054] (describing how communication messages can be

wirelessly transmitted from the camera), Fig. 2. The components that perform the

transmission functions described above correspond to a transmission module as

recited in this claim. See also Ex. 1012, ¶ 61.

13. Claim 21

a) “The device as in claim 1, wherein the encryption module is further adapted for encrypting the digital image file and associated information immediately upon image capture.”

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

30

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim element 1(g). See Ex. 1012, ¶ 62; analysis and

citations above for claim element 1(g). For example, as discussed above, Davis

discloses that the encryption of the digital image file and associated information

can occur “at or shortly after image capture in the camera.” See Ex. 1003, ¶

[0169]. Specifically, Davis discloses that “an image may be secured and

authenticated at various stages of processing” including “at or shortly after image

capture in the camera,” and that encryption provides one way to implement such

security. Id. One of ordinary skill in the art at the time of the alleged invention of

the ’872 Patent would thus understand Davis’s disclosure of how encryption occurs

for it to be done “immediately upon image capture.” See Ex. 1012, ¶ 62.

14. Claim 22

a) “The device as in claim 1, further comprising an input module for inputting information regarding the captured image, wherein the processing module associates the inputted information to the digital image file.”

Davis discloses these limitations. For example, Davis discloses that its

camera includes a “camera UI” with “input devices.” See Ex. 1003, ¶ [0058]. The

“user interface accepts user input via the buttons 30-34.” Id., ¶ [0061]. The UI

provides “[o]ne source of data” that is “associated with images in the camera.” See

id., ¶ [0077]; see also analysis and citations above for claims 4-6, describing

components for receiving input from a user, such as touchscreen components.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

31

Davis also discloses that the components that reflect a processing module disclosed

above for claim element 1(f) associate inputted information to a digital image file.

See above citations and analysis regarding claim element 1(f) above in Part

IX.A.1.f; Ex. 1012, ¶ 63.

15. Claim 23

a) “The device as in claim 22, wherein the processing module is adapted to create a separate information file including the location and inputted information that is linked to the digital image file.”

Davis discloses these limitations. For example, Davis discloses that its

camera is adapted such that “the auxiliary data associated with the image,” which

would include the location and inputted information, “can be maintained separately

from the image.” Ex. 1003, ¶¶ [0104]-[0105]. More specifically, Davis discloses

that “[o]ne way to associate data with an image . . . is to store the data in a location

external to the image file, and create an association between the image file and the

external data.” Id., ¶ [0026]. The “image may be associated with the external data

via a reference encoded in the image itself or in the image file that refers to the

external data.” Id. See also Ex. 1012, ¶ 64.

16. Claim 24

a) “The device as in claim 22, wherein the processing module is adapted to append the location and inputted information to the digital image file.”

Davis discloses these limitations. For example, Davis discloses that “[o]ne

way to associate data with an image is to store the data in the image container (e.g.,

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

32

a file), but outside the image.” Ex. 1003, ¶ [0026]. For example, the image may

be stored in a file format that allows metadata, which would include the location

and inputted information, “to be stored in the file header.” See id., ¶ [0101]. See

also Ex. 1012, ¶ 65.

17. Claim 27

a) “A method for verifying an assignment of a user, the method comprising the steps of:”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 1, which describes the functions and operations

performed by the components disclosed by Davis. See Ex. 1012, ¶ 66; analysis

and citations above for claim elements 1(a)-1(g); analysis and citations below for

the remaining limitations of claim 27.

b) “verifying a user of the device to enable use of the device;

Davis and Steinberg disclose these limitations for at least the same reasons

as discussed above with respect to claim element 1(b). See Ex. 1012, ¶ 67;

analysis and citations above for claim element 1(b) in Part IX.A.1.b. The functions

performed by the components described above regarding Davis and Steinberg for

claim element 1(b) reflect processes that disclose this limitation.

c) “upon verification, receiving assignment information for the user;”

Davis and Steinberg disclose these limitations for at least the same reasons

as discussed above with respect to claim element 1(b). See Ex. 1012, ¶ 68;

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

33

analysis and citations above for claim element 1(b) in Part IX.A.1.b. The functions

performed by the components described above regarding Davis and Steinberg for

claim element 1(b) reflect processes that disclose this limitation.

d) “capturing an image with an imaging device relating to the assignment and creating a digital image file;”

Davis and Steinberg discloses these limitations for at least the same reasons

as discussed above with respect to claim element 1(c). See Ex. 1012, ¶ 69;

analysis and citations above for claim element 1(c) in Part IX.A.1.c. The functions

performed by the components described above regarding Davis and Steinberg for

claim element 1(c) reflect processes that disclose this limitation..

e) “determining an identity of the user at a time of the image capture;”

Davis and Steinberg discloses these limitations for at least the same reasons

as discussed above with respect to claim element 1(c). See Ex. 1012, ¶ 70;

analysis and citations above for claim element 1(c) in Part IX.A.1.c. The functions

performed by the components described above regarding Davis and Steinberg for

claim element 1(c) reflect processes that disclose this limitation.

f) “determining a location of the device upon image capture;”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim element 1(d). See Ex. 1012, ¶ 71; analysis and

citations above for claim element 1(d) in Part IX.A.1.d. The functions performed

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

34

by the components described above regarding Davis for claim element 1(d) reflect

processes that disclose this limitation.

g) “determining a date and time of the image capture;”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim element 1(e). See Ex. 1012, ¶ 72; analysis and

citations above for claim element 1(e) in Part IX.A.1.e. The functions performed

by the components described above regarding Davis for claim element 1(e) reflect

processes that disclose this limitation.

h) “associating the assignment information, the user identity, location information and the date and time to the digital image file; and”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim element 1(f). See Ex. 1012, ¶ 73; analysis and

citations above for claim element 1(f) in Part IX.A.1.f. The functions performed

by the components described above regarding Davis for claim element 1(f) reflect

processes that disclose this limitation.

i) “encrypting the associated information and digital image file upon image capture.”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim element 1(g). See Ex. 1012, ¶ 74; analysis and

citations above for claim element 1(g) in Part IX.A.1.g. The functions performed

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

35

by the components described above regarding Davis for claim element 1(g) reflect

processes that disclose this limitation.

18. Claim 28

a) “The method as in claim 27, further comprising the step of transmitting the encrypted information and digital image file to a computing device.”

Davis discloses these limitations. For example, Davis discloses that its

digital camera “is equipped with one or more external interfaces to transfer images,

image related data, and operating parameters to and from external devices.” Ex.

1003, ¶ [0040]; see also id., ¶¶ [0041]-[0043], [0053]-[0054]. Davis explains that

the encryption may occur “at or shortly after image capture in the camera,” and

thus would occur before the stage of “uploading the image from the camera.” Id.,

¶ [0169]; see also Ex. 1012, ¶ 75. In other words, because encryption occurs

before transmission, “the encrypted information and digital image file” in Davis

would be transmitted to the external computing device. See Ex. 1012, ¶ 75. This

understanding is confirmed by the fact that the external device to which an image

with associated information is sent must decrypt the encrypted information. See

Ex. 1003, ¶¶ [0201]-[0203]; see also Ex. 1012, ¶ 75.

19. Claim 30

a) “The method as in claim 29 further comprising the step of prompting the user for information regarding at least one assignment.”

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

36

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 4 in Part IX.A.4. The functions performed by the

components described above regarding Davis for claim 4 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 76; analysis and citations above for claim

4. By prompting a user for information regarding a captured image that relates to a

session, as discussed with respect to claim 4, the information would also relate to

the session (e.g., assignment). See Ex. 1012, ¶ 76; Ex. 1003, ¶¶ [0066]-[0071].

20. Claim 31

a) “The method as in claim 30, wherein the prompting step includes displaying at least one question to the user.”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 4 in Part IX.A.4. The functions performed by the

components described above regarding Davis for claim 4 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 77; analysis and citations above for claim

4. Moreover, one of ordinary skill in the art would have understood that the

disclosure by Davis regarding providing the list of possible selections for a user, as

discussed with respect to claim 4, was presenting the user with a question as to

which selection to make. See Ex. 1012, ¶ 77.

21. Claim 34

a) “The method as in claim 30, further comprising the steps of: receiving text input via a character recognition capture device regarding the capture image;”

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

37

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 5 in Part IX.A.5. In addition, Davis explains that the

metadata, which a user inputs into the device that is associated with a captured

image, is commonly text data. Ex. 1003, ¶¶ [0154], [0026], [0027], [0097]. The

functions performed by the components described by Davis reflect processes that

disclose this limitation. See Ex. 1012, ¶ 78; analysis and citations above for claim

5.

b) “translating the text input into alphanumeric characters; and”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 5 in Part IX.A.5. The functions performed by the

components described above regarding Davis for claim 5 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 79; analysis and citations above for claim

5. One of ordinary skill in the art would have understood given the disclosure of

Davis that by the input via keyboard or other input mechanisms disclosed by Davis

would necessarily result in the translation of such input into alphanumeric

characters. See, e.g., Ex. 1003, ¶ [0183] (explaining that the metadata descriptors

are “alphanumeric”); Ex. 1012, ¶ 79. Specifically, the text input described in

Davis that is used for metadata entry (see id., ¶¶ [0058], [0063]) must be translated

into alphanumeric characters because alphanumeric characters are produced. Ex.

1012, ¶ 79; see also Ex. 1001, 4:55-59 (broadly describing alphanumeric character

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

38

translation). For example, the user in Davis may provide a text input associated

with the descriptor “Child1”. See Ex. 1003, ¶ [0062]. In order for the “descriptor

selected by the user” to then be “embedded in the image . . . in the form of text,”

the selection would necessarily need to be translated into alphanumeric characters

(e.g., “Child1”) associated with the user’s selection.

c) “associating the inputted text to the digital image file.”

Davis discloses this limitation for at least the same reasons as discussed

above with respect to claim 22 and claim element 27(h) in Parts IX.A.14 and

IX.A.17.h. The functions performed by the components described above regarding

Davis for claim 22 and claim element 27(h) reflect processes that disclose this

limitation. Ex. 1012, ¶ 80; analysis and citations above for claim 22 and claim

element 27(h).

22. Claim 35

a) “The method as in claim 30, further comprising the steps of: receiving spoken input via a microphone; and associating the spoken input to the digital image file.”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 2 in Part IX.A.2. The functions performed by the

components described above regarding Davis for claim 2 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 81; analysis and citations above for claim

2.

23. Claim 36

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

39

a) “The method as in claim 30, further comprising the steps of: transmitting the encrypted information and digital image file to a computing device;”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 28 in Part IX.A.18. The functions performed by the

components described above regarding Davis for claim 28 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 82; analysis and citations above for claim

28.

b) “unencrypting the information and digital image file at the computing device; and verifying the location and date and time of the image capture.”

Davis discloses these limitations. For example Davis discloses that, “to

check authenticity of the metadata,” which would include location, date, and time,

“a device or application with the key decrypts the metadata from the watermark

and from an external source.” Ex. 1003, ¶¶ [0067], [0201]. “Then the decrypted

metadata from both sources is compared to check for differences in the metadata

that evince tampering.” Id. See also citations and analysis regarding the

encryption functions of Davis above for claim element 1(g) in Part. IX.A.1.g.

Thus, Davis necessarily discloses unencrypting the information and digital image

file and verifying the location and data and time of the image capture given that

Davis discloses this type of information is part of the metadata that is encrypted

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

40

and sent to the external device for comparison and authentication checking. See

also Ex. 1012, ¶ 83.

24. Claim 38

a) “The method as in claim 27, wherein the associating step includes creating a separate information file including the associated information that is linked to the digital image file.”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 23 in Part IX.A.15. The functions performed by the

components described above regarding Davis for claim 23 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 84; analysis and citations above for claim

23.

25. Claim 39

a) “The method as in claim 27, wherein the associating step includes appending the associated information to the digital image file.”

Davis discloses these limitations for at least the same reasons as discussed

above with respect to claim 24 in Part IX.A.16. The functions performed by the

components described above regarding Davis for claim 24 reflect processes that

disclose this limitation. See Ex. 1012, ¶ 85; analysis and citations above for claim

24.

B. Ground 2: Davis, Steinberg, and Steinberg ’902 Render Claims 7, 13, 25, 26, and 29 Obvious

1. Claim 7

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

41

a) “The device as in claim 3, wherein the display module displays geographic directions to the user from at least one location to a location of the assignment.”

As discussed in more detail above with respect to claim 1, Davis discloses a

camera that receives operating parameters relating “selected GPS locations.” Ex.

1003, ¶ [0068]; analysis and citations above for claim element 1(a) and claim 3.

Davis and Steinberg do not explicitly disclose that “the display module displays

geographic directions to the user from at least one location to a location of the

assignment.” Ex. 1012, ¶ 86. However, it would have been obvious to a person of

skill in the art at the time of the alleged invention of the ’872 Patent to modify the

combination of Davis and Steinberg to include this feature based on the knowledge

of a person of ordinary skill in the art and the disclosure of Steinberg ’902. Ex.

1005; Ex. 1012, ¶ 86.

Steinberg ’902 discloses a digital camera that can receive data from an

external source. Ex. 1005, 12:12-15; Ex. 1012, ¶ 87. For example, similarly to the

“selected GPS locations” sent to the camera of Davis, Steinberg ’902 discloses that

“[o]perational data can be sent to inform the user when and where to take a

picture.” Ex. 1005, 12:18-19. Moreover, a “map showing where to take a picture

can be sent” to the camera, “which can be displayed by the user on a camera visual

display.” Id., 12:19-21. The map in Steinberg ’902 would thus provide directions

for at least one location (e.g., a location on the map other than a location at which a

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

42

picture should be taken) to a location at which a picture should be taken. See Ex.

1012, ¶ 87.

It would have been obvious to one of ordinary skill in the art at the time of

the alleged invention of the ’872 Patent to modify the camera disclosed in Davis

such that its display module displays a map showing where to take a picture (e.g.,

“selected GPS locations”), as disclosed in Steinberg ’902. See Ex. 1012, ¶ 88. In

particular, since the camera of Davis already includes a display, and already

receives GPS coordinates governing where to take a picture (see, e.g., analysis and

citations above for claim element 1(a)), one skilled in the art would have

recognized that it would have been a simple and common sense combination of

prior art elements to add the map functionality of Steinberg ’902 to Davis’s

camera. See Ex. 1012, ¶ 88. The map in Steinberg ’902 merely represents one

type of data that Davis already is capable of displaying. See, e.g., Ex. 1003, ¶

[0039], [0059] (the display module “may produce visual . . . output . . . [and] may

have a display screen, with . . . support for video output”). One of ordinary skill in

the art would have thus realized that the combination would have been common

sense, predictable, and within the realm of knowledge of one skilled in the art at

the time of the alleged invention. Id. See KSR Int’l Co., 550 U.S. at 417 (2007);

Ex. 1012, ¶ 88.

2. Claim 13

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

43

a) “The device as in claim 1, further comprising an auxiliary input module for generating auxiliary information related to the captured image, wherein the auxiliary information is date, time, sequence number of the capture image and user information.”

As discussed for claim element 1(f), Davis discloses that its digital camera

includes a module that generates auxiliary information relating to the captured

image that is associated to the image and that includes a time, date, and user

identity. See Ex. 1003, ¶¶ [0060], [0067]-[0070], [0107], [0108], [0111]; analysis

and citations above for claim element 1(f) in Part IX.A.1.f. Moreover, Davis also

suggests that a sequence number of the captured image is generated by the camera.

See Ex. 1003, ¶¶ [0068], [0199]. Davis and Steinberg do not explicitly disclose to

generate a “sequence number” of the captured image. Ex. 1012, ¶ 89. However, it

would have been obvious to a person of skill in the art at the time of the alleged

invention of the ’872 Patent to modify the combination of Davis and Steinberg to

include this feature based on the knowledge of a person of ordinary skill in the art

and the disclosure of Steinberg ’902. Ex. 1005; Ex. 1012, ¶ 89.

Steinberg ’902 discloses a digital camera that records sequence numbers of

captured image through the use of “permanent programming to read and increment

a counter and assign a unique number to each image received.” Ex. 1005, 5:59-61.

“In this way each image has associated with it a unique number” that would make

it uniquely identifiable, which users often find convenient. See id., 5:61-63, 8:10-

13; see also Ex. 1012, ¶ 90.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

44

It would have been obvious to one of ordinary skill in the art at the time of

the alleged invention of the ’872 Patent to modify the camera disclosed in Davis to

generate a “sequence number” of the captured image, as disclosed in Steinberg

’902. See Ex. 1012, ¶ 91. For example, one of ordinary skill in the art would have

recognized that such a modification would have been a simple and common place

application of a known technique (the technique in Steinberg ’902 of generating a

unique sequence number for each image so that each image is uniquely

identifiable) to a known device (the camera of Davis) to yield the predictable result

of the camera in Davis including the sequence number in the metadata. Id.

Indeed, Davis already suggests a number of similar types of metadata to include

when capturing an image (see, e.g., Ex. 1003, ¶¶ [0107]-[0135] (disclosing, for

example, “picture identifiers, e.g., industry or application specific identifiers”)) and

it would have been simple and common sense to supplement or replace this data

with a sequence number without affecting the predictable operation of Davis’s

camera. See Ex. 1012, ¶ 91. Thus, one of ordinary skill would have understood

that implementing such a modification would have been a common sense and

predictable modification that was within the realm of knowledge of one skilled in

the art at the time of the alleged invention. See KSR, 550 U.S. at 401, 417; Ex.

1012, ¶ 91.

3. Claim 25

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

45

a) “The device as in claim 1, further comprising a display module for displaying to a user geographic directions to the location.”

Davis, Steinberg, and Steinberg ’902 disclose these limitations for at least

the same reasons as discussed above with respect to claims 3 and 7 in Parts IX.A.3,

IX.B.1. See Ex. 1012, ¶ 92; analysis and citations above for claims 3 and 7.

4. Claim 26

a) “The device as in claim 1, further comprising a picture sequence module for recording a sequence number of the captured image, wherein the processor module associates the sequence number to the captured image.”

Davis, Steinberg, and Steinberg ’902 disclose a picture sequence module for

recording a sequence number of the captured image at least the same reasons as

discussed above with respect to claim 13 in Part.IX.B.2. See Ex. 1012, ¶ 93;

analysis and citations above for claim 13. Also, it would have been obvious to one

skilled in the art at the time of the alleged invention to configure the processor

module discussed above regarding claim element 1(f) for Davis to associate the

sequence number recorded by the combined system of Davis, Steinberg, and

Steinberg ’902 to the captured image. Such a person would have been motivated

to make such a modification because it would have provided additional metadata

that would have been linked to a captured image and used for verification purposes

regarding a session. See e.g., discussion regarding claim elements 1(f) and claims

13, 36. Such a person would have been so motivated given that Davis discloses

associating information relating to a captured image for subsequent use, such as

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

46

verification purposes. The combined system of Davis, Steinberg, and Steinberg

’902 would have been configured to include the additional information of image

sequence numbers, which are also linked to a captured image. Ex. 1012, ¶ 93.

Given the disclosures of these references, and the associating features that

addressed above regarding Davis, such a skilled person would have found

configuring the processing module of the combined system to associate the

sequence numbers to an image (like that disclosed by Steinberg ’902) to be a

predictable and common sense implementation that would have been within the

realm of knowledge of such a person at the time of the alleged invention. See KSR,

550 U.S. at 401, 417; Ex. 1012, ¶ 93.

5. Claim 29

a) “The method as in claim 27, wherein upon verification of the user, receiving geographic directions from at least one location to a location of the assignment and displaying the directions to the user.”

Davis, Steinberg, and Steinberg ’902 disclose these limitations for at least

the same reasons as discussed above with respect to claim 7 in Part IX.B.1. The

functions performed by the components described above regarding Davis,

Steinberg, and Steinberg ’902 for claim 7 reflect processes that disclose this

limitation. See Ex. 1012, ¶ 94; analysis and citations above for claim 7.

C. Ground 3: Davis, Steinberg, and Terp Render Claim 14 Obvious

1. Claim 14

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

47

a) “The device as in claim 1, further comprising a scanning module for scanning information to be associated with the digital image file.”

Davis and Steinberg disclose all of the features of claim 1, but do not

explicitly disclose “a scanning module for scanning information to be associated

with the digital image file,” as recited in claim 14. However, it would have been

obvious to a person of ordinary skill in the art at the time of the alleged invention

of the ’872 Patent, however, to modify the combination of Davis and Steinberg to

implement this feature based on the disclosure of Terp. Ex. 1006; Ex. 1012, ¶ 95.

Terp discloses a portable inventory device that “includes at least an image

scanner, a digital camera, and a receiver that is configured to receive a plurality of

data files that represent standard inventory profiles for a plurality of inventory

items.” Ex. 1006, 2:17-24; see also id., 4:11-17, 6:15-26. The device also includes

a processor “configured to process an image of an inventory item’s identifier that is

captured by the image scanner to determine a representation for the identifier that

may be processed by a computer.” Id., 4:13-24; see also id., 2:29-3:4. “[T]he

identifier may be bar codes, actual numbers and letter and any other form of an

identifier that can be imaged and processed by a computer.” Id., 4:22-24; see also

id., 2:30-33. Ex. 1012, ¶ 96. Further, Terp describes a process in which a user of a

portable device scans a VIN associated with an automobile. Ex. 1006, 8:14-34.

“If the VIN is on record, then step 524 retrieves the record from the storage device

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

48

204.” Id., 8:31-38. If the VIN is not on record, Terp explains that “a vehicle

record [is created] by creating a bin on the storage device 204 and record[ing] the

VIN in the bin.” Id. Next, the process “prompts the user to take a photograph of

the vehicle and receives input from the digital camera.” Id., 9:29-33. The

photographs are stored in the vehicle record. Id., 9:19-36. Because the record

includes a VIN of an automobile obtained using an image scanner and pictures of

the automobile, Terp discloses an image capture device that includes “a scanning

module for scanning information to be associated with the digital image file,” as

recited in claim 14. Ex. 1012, ¶ 97.

It would have been obvious to a person of ordinary skill in the art at the time

of the alleged invention to modify the device of Davis to include the ability to scan

information to be associated with a digital image, similar to as recited in Terp, to

provide another mechanism for associating information with the digital image. Ex.

1012, ¶ 98. One skilled in the art would have been motivated to look to Terp to

compliment the system and processes of Davis given that the references disclose

devices for capturing images and associating information with the captured image

for later access. See e.g., citations and analysis above regarding Davis and Terp.

Moreover, as explained in Terp, manual entry of information may be cumbersome,

inefficient, and result in human error. Ex. 1006, 1:33-7. The disclosure of Terp

would have informed one of ordinary skill that including the ability to scan

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

49

information to be associated with a digital image, would have permitted

information to be associated with an image to be gathered easily, quickly, and

accurately. Ex. 1006, 1:33-7; Ex. 1012, ¶ 98. Thus, one of ordinary skill would

have understood that implementing such a modification would have been a

common sense and predictable modification that was within the realm of

knowledge of one skilled in the art at the time of the alleged invention. See KSR,

550 U.S. at 401, 417; Ex. 1012, ¶ 98.

D. Ground 4: Davis, Steinberg, and Fukunaga Render Claims 15, 19, 20, and 32 Obvious

1. Claim 15

a) “The device as in claim 1, further comprising a scanning module for reading a symbology associated with a printed digital image and wherein the processing module is adapted to use the symbology to retrieve the associated information of the digital image file.”

Davis and Steinberg disclose all of the features of claim 1, but do not

explicitly disclose “a scanning module for reading a symbology associated with a

printed digital image and wherein the processing module is adapted to use the

symbology to retrieve the associated information of the digital image file,” as

recited in claim 15. However, it would have been obvious to a person of ordinary

skill in the art at the time of the alleged invention of the ’872 Patent, however, to

modify the combination of Davis and Steinberg to implement this feature based on

the disclosure of Fukunaga. Ex. 1007; Ex. 1012, ¶ 99.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

50

Fukunaga describes “a user terminal such as a camera-equipped cellular

phone, . . . a personal digital assistance (PDA) and the like” that captures a digital

image, (Ex. 1007, 1:15-20; see also id., Abstract, 6:21-24, 6:48-49, Figs. 1, 3),

which may have “additional information,” such as GPS information, voice

information, text information, and music information, associated with it (see, e.g.,

id., 2:61-64, 6:49-66). The image and additional information is uploaded to a

server for storage, which the server receives as one unit referred to as

“image+information.” Id., 7:26-35. The server produces a “URL for accessing the

image+information,” which may be encoded as a “code (for example, a two-

dimensional code such as a QR code).” See, e.g., id., 5:34-46, 7:42-48. Next, “a

photo print having the image and the QR code printed on a print paper is

produced.” See, e.g., id., Abstract, 2:24-27, 7:49-54, 9:13-32, Fig. 4; see also id.,

9:59-62 (instead of a QR code, any “other two-dimensional code, a bar code or the

URL string may be printed”). A user terminal (e.g., camera-equipped cellular

phone) “has a function of identifying the QR code printed on the photo print and

decrypting the identified QR code to acquire the URL.” See, e.g., id., 6:36-38,

7:55-60. As shown in Figure 3, “the image+information is accessed by using the

above described acquired URL.” See, e.g., id., 5:51-60, 7:61-64. For example, “if

the image+information is accessed by using the URL (http://abcdejp/1/1), the

service server 10 sends the additional information . . . attached to the image 23 to

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

51

the cellular phone 35, and provides a service for reproducing the voice on the

cellular phone 35, or a service for displaying the position information for shooting

the image, on a monitor on the cellular phone 35.” Id., 7:61 - 8:4. See also Ex.

1012, ¶¶ 100-101.

It would have been obvious to a person of ordinary skill in the art at the time

of the alleged invention to modify the device of Davis to include a scanning

module for reading a symbology associated with a printed digital image and a

processing module adapted to use the symbology to retrieve the associated

information of the digital image file, similar to as recited in Fukunaga, to provide

another means for retrieving images and associated information that is convenient

and easy to use. Ex. 1012, ¶ 102. The addition of Fukunaga’s symbology

functionality to Davis would have been a common sense and predictable approach

to enabling sharing of information associated with images, which would not have

hindered any of Davis’s or Steinberg’s existing functionality. Id. The combination

would have resulted in the camera’s processing components described above in

connection with claim 1 to use the symbology to retrieve the associated

information of the digital image file. Id. Thus, one of ordinary skill would have

understood that implementing such a modification would have been a common

sense and predictable modification that was within the realm of knowledge of one

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

52

skilled in the art at the time of the alleged invention. See KSR, 550 U.S. at 401,

417; Ex. 1012, ¶ 102.

2. Claim 19

a) “The device as in claim 16, wherein the capture module is coupled to a scanning module for decoding a symbology captured as a digital image by the capture module.”

Davis, Steinberg, and Fukunaga disclose these limitations for at least the

same reasons as discussed above with respect to claim 15 in Part IX.D.1. See Ex.

1012, ¶ 103; analysis and citations above for claim 15. Moreover, Fukunaga

explains that the scanning component identifies and decrypts the QR code (or other

type of symbology) and is thus decoded (Ex. 1007, 6:36-38; see also id., Abstract,

3:41-46, 7:55-60), which is used “for accessing the image+information” (id., 7:42-

45; see also id., Abstract, 5:41-43, 5:51-60, 7:61-8:4). The combined system of

Davis, Steinberg, and Fukunaga would thus decode the symbology. Ex. 1012, ¶

103. Moreover, one of ordinary skill in the art would have found it obvious to

modify the combined system such that the capture components described above for

claim element 1(c) would be coupled to the scanning components described above

for claim 19 in order to allow these components to interact to allow symbology to

be captured as an image and provided to the scanning components for decoding,

which is consistent to the operation of such features in the combination of

Fukunaga and Davis. Such a person would have been motivated to configure the

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

53

combined system of Davis, Steinberg, and Fukunaga given the disclosure of the

functions of the image capture devices in these references and found the

modification a predictable and common sense implementation to achieve the result

of obtaining the symbology information for decoding through interconnections

between the components that perform such functions. See KSR, 550 U.S. at 401,

417; Ex. 1012, ¶ 104.

3. Claim 20

a) “The device as in claim 19, wherein the processing module is adapted to use the symbology to retrieve the associated information of the digital image file.”

Davis, Steinberg, and Fukunaga disclose these limitations for at least the

same reasons as discussed above with respect to claims 15 and 19 in Parts IX.D.1

and IX.D.2. See Ex. 1012, ¶ 105; analysis and citations above for claims 15 and

19. As disclosed by Fukunaga and discussed above for claim 15, a QR code is

used to retrieve an image and associated information. See, e.g., id., 5:51-60, 7:61-

64, Fig. 3. Ex. 1012, ¶ 105. One of ordinary skill in the art at the time of the

alleged invention would have found it obvious to modify the combined system

such that the processing components described above for claim element 1(f) would

perform the symbology-based retrieval described for claim 20. Ex. 1012, ¶ 105.

Doing so would have allowed the components that associate information to an

image to participate in the retrieval of that information based on identifier

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

54

information, such as the QR code or other symbols. Id. Such a person would have

thus found such a modification a predictable and common sense implementation

based on the technologies disclosed by Davis and Fukunaga, which would have

been within the realm of knowledge of such a person. See KSR, 550 U.S. at 401,

417; Ex. 1012, ¶ 105.

4. Claim 32

a) “The method as in claim 31, further comprising the step of retrieving the associated information by scanning a symbology printed with the captured digital image.”

Davis, Steinberg, and Fukunaga disclose these limitations for at least the

same reasons as discussed above with respect to claim 15 in Part IX.D.1. The

functions performed by the components described above regarding Davis,

Steinberg, and Fukunaga for claim 15 reflect processes that disclose this limitation.

See Ex. 1012, ¶ 106; analysis and citations above for claim 15.

E. Ground 5: Davis, Steinberg, and Knowles Render Claims 8, 17, and 33 Obvious

1. Claim 8

a) “The device as in claim 3, wherein the display module further includes an audio output device for audibly prompting a user to input information regarding the captured image.”

Davis discloses that the digital camera includes “output devices” for “audio

output.” Ex. 1003, ¶ [0059]. The audio output device of Davis is used to “allow

for playback of voice instructions, and [provide] output of a text to speech

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

55

synthesis system.” Id. Davis does not explicitly recite that its audio output device

is used “for audibly prompting a user to input information regarding the captured

image,” as recited in claim 8. However, it would have been obvious to a person of

ordinary skill in the art at the time of the alleged invention of the ’872 Patent to

modify the combination of Davis and Steinberg to implement this feature based on

the disclosure of Knowles. Ex. 1008; Ex. 1012, ¶ 107.

Knowles describes a wireless camera apparatus for capturing and delivering

digital image “messages” to a remote destination. Ex. 1008, Abstract. According

to Knowles, information associated with an image may include an audio message

(id. at 8:13-28, 11:27-42), an address (id. at 12:16-31), or classification (id. at

12:16-20, 12:31-35). The audio message in Knowles is similar to the audio

message that may be recorded and associated with an image in Davis. See, e.g.,

Ex. 1003, ¶¶ [0058] (the digital camera “may also be configured to receive voice

input through a microphone, voice codec, and voice recognition hardware and

software”), [0125] (“Sound annotation” is associated to the image file), [0198]

(“As part of the embedding process, a sound (such as a voice instruction or

comment) can be compressed and embedded into the image’s watermark”).

Regarding the audio message, Knowles describes an “audio recording process” in

which the first step “plays . . . [an] audible prompt asking the wireless device user

to record a voice message.” Ex. 1008, 11:27-30. According to Knowles, “the user

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

56

is prompted . . . by audio prompt to enter the recipient’s e-mail address” or

classification. Id., 12:16-35. Ex. 1012, ¶ 108.

It would have been obvious to a person of ordinary skill in the art at the time

of the alleged invention to modify the display module components of the camera of

Davis (see e.g., Parts IX.A.3, IX.A.4) to audibly prompt a user to input audio

information regarding a captured image, such as disclosed in Knowles, to inform a

user that the user terminal is waiting for input. Ex. 1012, ¶ 109. One of ordinary

skill in the art would have been motivated to make such a modification because

Davis already discloses user-inputted information, such as audio information,

regarding an image (see, e.g., Ex. 1003, ¶¶ [0058], [0125], [0198]) and Knowles

discloses audibly prompting a user to input information regarding an image (see,

e.g., Ex. 1008, 11:27-30, 12:16-35). One of ordinary skill in the art would have

recognized that the audible prompting in Knowles would have provided a simple

and easy-to-implement way to improve Davis’s camera’s input functionality,

particularly since Davis’s camera is already structured to include an audio output

device capable of providing such prompting. Ex. 1003, ¶ [0059]; Ex. 1012, ¶ 109.

Moreover, one of ordinary skill would have known that prompting a user for input

was a common user interface feature, and therefore would have been a simple

design choice that resulted in an improved user interface experience. Ex. 1012, ¶

109. Thus, one of ordinary skill would have understood that implementing such a

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

57

modification would have been a common sense and predictable modification that

was within the realm of knowledge of one skilled in the art at the time of the

alleged invention. See KSR, 550 U.S. at 401, 417; Ex. 1012, ¶ 109.

2. Claim 17

a) “The device as in claim 16, further comprising an audio output device for audibly prompting a user to input information regarding the captured image and for audibly producing the received communication messages.”

Davis, Steinberg, and Knowles disclose these limitations for at least the same

reasons as discussed above with respect to claim 8 in Part IX.E.1. See Ex. 1012, ¶

110; analysis and citations above for claim 8. Also, the combined system and

processes of Davis, Steinberg, and Knowles also discloses audibly producing the

received communication messages” given that the audio output device of Davis is

configured to produce “audio output, and allow for playback of voice instructions,

and output of a text to speech synthesis system.” Ex. 1003, ¶ [0059]; Ex. 1012, ¶

110. Such voice instructions are included in received communication messages,

such as within metadata embedded with a watermark, and are extracted and played

as audio output. See, e.g., id., ¶ [0198]. See also Ex. 1012, ¶ 110. It would have

been obvious to one of ordinary skill in the art to modify the disclosed combined

features of Davis, Steinberg, and Knowles to include an output device for audibly

prompting a user to input information regarding the captured image and for audibly

producing the received communication messages for reasons similar to those

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

58

discussed above for claim 8. See analysis and reasons to combine these references

above in Part IX.E.1; Ex. 1012, ¶ 110.

3. Claim 33

a) “The method as in claim 30, wherein the prompting step includes audibly producing at least one question to the user.”

Davis, Steinberg, and Knowles disclose these limitations for at least the same

reasons as discussed above with respect to claim 8. See Ex. 1012, ¶ 111; analysis

and citations above for claim 8. The functions performed by the components

described above regarding Davis, Steinberg, and Knowles for claim 8 reflect

processes that disclose this limitation. See Ex. 1012, ¶ 111; analysis and citations

above for claim 8. One of ordinary skill in the art would have understood that the

disclosure by Knowles concerning audibly instructing the wireless device user to

record a voice message,” (Ex. 1008, 11:27-30), and asking “the user . . . by audio

prompt to enter the recipient’s e-mail address,” (id., 12:16-35), to be a disclosure

of presenting the user with a question as to which selection to make. See Ex. 1012,

¶ 111.

F. Ground 6: Davis, Steinberg, and Dodge Render Claim 37 Obvious

1. Claim 37

a) “The method as in claim 36, further comprising the step of verifying at least one task of the assignment information has been completed.”

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

59

Davis discloses the assignment of tasks to a user of a digital camera. See Ex.

1003, ¶¶ [0065]-[0071]. While Davis does not explicitly disclose “the step of

verifying at least one task of the assignment information has been completed,” as

recited in claim 37, it would have been obvious to a person of ordinary skill in the

art at the time of the alleged invention of the ’872 Patent to modify the

combination of Davis and Steinberg to implement this feature based on the

disclosure of Dodge. Ex. 1009; Ex. 1012, ¶ 112.

Dodge describes to a system where a user assigns “criteria for [a]

photograph” to “selected photographers.” Ex. 1009, Abstract; see also id., 12:9-

51, 15:56 - 16:13. Dodge discloses that, after receiving a project assignment, a

photographer will upload images and comments regarding the project. See id.,

Abstract, 28:5-15, 29:50-67. If “no images [are] uploaded,” an “error message” is

displayed. Id., 29:40-42. After the uploaded images are saved, the stage of the

project is updated and a notification of the update is sent to the customer. Id.,

30:1-27. The user may either approve the submission or request a change. Id.,

2:59 - 3:3, 18:46-51, 29:38-40. The system in Dodge continually keeps track of

which projects are finished and which projects are open and still need input from

the customer. See, e.g., id., 16:59 - 17:12. Thus, in Dodge, both the system and

the customer verify that a photographic assignment has been completed. Ex. 1012,

¶ 113.

Petition for Inter Partes Review of U.S. Patent No. 7,456,872

60

It would have been obvious to a person of ordinary skill in the art at the time

of the alleged invention to modify the process disclosed in Davis to include a step

of verifying at least one task of the assignment information has been completed,

such as disclosed in Dodge. Ex. 1012, ¶ 114. Such a person would have been so

motivated to make such a modification to improve the interaction between the

photographer and the assignment provider (e.g., the employer or supervisor

disclosed in Davis), and to streamline the ability to handle change or preview

requests by the assignment provider. Ex. 1009, 1:31-35, 1:65-67, 2:1-9; Ex. 1012,

¶ 114. Such a person would have recognized that the verification step could easily

be performed mentally by a user, and even if performed by a machine, would have

only required a simple modification of Davis’s camera or external device receiving

an image from the camera, and thus realized the modification as a common sense

and predictable one. Ex. 1012, ¶ 114. See KSR, 550 U.S. at 401, 417; Ex. 1012, ¶

114.

X. Conclusion

For the reasons given above, Petitioner requests inter partes review of the

’872 Patent and cancellation of claims 1-39 of the ’872 Patent.

Respectfully submitted,

Dated: January 26, 2015 By: /Joseph E. Palys/ Joseph E. Palys, Back-up Counsel Registration No. 46,508 Counsel for Petitioner

Petition for Inter Partes Review – Patent No. 7,456,872

CERTIFICATE OF SERVICE

I hereby certify that on this 26th day of January, 2015, a copy of the

foregoing Petition for Inter Partes Review of U.S. Patent No. 7,456,872 under

35 U.S.C §§ 311-319 and 37 C.F.R. §§ 42.1-.80 & 42.100-.123 and supporting

materials were served by express mail upon the following:

Hespos & Porco LLP 110 West 40th Street Suite 2501 New York, NY 10018

Dated: January 26, 2015 Respectfully submitted,

/Joseph E. Palys/ Joseph E. Palys Paul Hastings LLP


Recommended