223-04-19

Distributed Software Development

323-04-19

Alpha presentation

Juraj Murgić, Xiaowei Ma

Review

• Our plan so far

• Statistics

• SW development methodology

• Parsing

• Integration

• Problems

• Alpha version

423-04-19

Our plan

523-04-19

Statistics

Member W43 W44 W45 W46 W47 Total

Juraj 25 26 23 20 18 112

Sasa 17 21 15 8 16 77

Zelimir 19 19 15 19 28 100

Fouad 21 12 27 20 21 101

Xiaowei 17 18 22 14 20 91

Trevor 27.5 19.5 27.5 23 23 120.5

Total: 126.5 115.5 129.5 104 126 601.5

623-04-19

Statistics

723-04-19

Statistics

823-04-19

Changes

• New data source

• Database– New tables:

• Foodfacts, RAPEX

923-04-19

Development methodology

• Process– SCRUM

• Tool:

1004/19/23

Quality requirements

1123-04-19

Risks

1223-04-19

SCRUM Voting

1323-04-19

First sprint

1423-04-19

Whiteboard

1523-04-19

Burn down chart

1623-04-19

Work distribution

1723-04-19

Data Source

• RAPEX

• Foodfacts & Amazon

1823-04-19

Parsing Rapex

1. Use python library to get the content of RAPEX page

2. Use RE to extract each product from report3. Use RE to extract all the columns of the table for

each product4. Get a list of values of rows in the table

• eg,[ [columnA1, columnB1, columnC1], [columnA2, columnB2, columnC2], …]

1923-04-19

Parsing Foodfacts & Amazon

1. Use Python RE to get a group of products in Food Facts, a list of product links is obtained.

2. Load each product link from the list and extract the UPC number.

3. Go to Amazon and search for the product there using the UPC number.

4. Save the Food Fact and Amazon product url.

2023-04-19

Parsing Foodfacts & Amazon

5. From Amazon : Product Description, Reviews Link and Star Ratings.

6. From Food Facts : Product Name, UPC, Ingredients, Warnings, Nutrition Facts, Description, Review Link And Stars, etc.

2123-04-19

Feeding Data To DB

1.Use Python DP-API connect to DB

MySQLdb

2.Pass SQL commands and value of rows

2223-04-19

Table Examples

Table Examples

Integration

• Integration over five iterations:– BuySafe v0.1

• Servlet

– BuySafe v0.2• Servlet + skeleton code (with errors)

– BuySafe v0.3• Struts 2 + skeleton code (on errors)

2523-04-19

Integration

– BuySafe v0.4• JSON + Struts 2 + database access

– BuySafe v0.5• JSON + Struts 2 + database acces + client GUI

2623-04-19

Integration problems

• Communicating changes

• Understanding changes

• New technologies– Struts 2– JSON

2723-04-19

Problems

• Fragmented names of products and contents

• Versions of programs– Python 2.7 – 3.3

• Database connection over distance

• Lack of time – exams

• Understanding team member implementation

2823-04-19

Other tools

• ArgoUML– class generation

2923-04-19

Implemented functionality

1. Create/Edit profile

2. Search product• By barcode (no scanner)• By title

3. View product details

4. Review and rate the product

5. Flag the product

3023-04-19

Still to implement

1. Search product1. By barcode with scanner

2. Product comparison

3. Product shopping list

4. Schedule DB updates (server)

5. Real-time parsing from other data sources (server)

3123-04-19

BuySafe

3223-04-19

BuySafe

3323-04-19

BuySafe

3423-04-19

BuySafe

3523-04-19

BuySafe

3623-04-19

BuySafe

3723-04-19

BuySafe

3823-04-19

BuySafe

3923-04-19

BuySafe

4023-04-19

BuySafe

4123-04-19

BuySafe

4223-04-19

Stay healthy, BuySafe

4323-04-19

Questions?

4423-04-19