C O N F I D E N T I A L Apr 19, 2023 1
StarCite Engineering Weekly Update
StarCite Engineering
June 23, 2008
C O N F I D E N T I A L Apr 19, 2023 2
Agenda
• 7 min – Attendee Mgmt Q2 – moved to next week
• 7 min – Update on technology strategy and advisory board
• 7 min – MarketView Q2 release and objectives
• 7 min – Reporting Q2 release and objectives
• 5 min – Summer Mobile Challenge
• 5 min – Update about stock option – paperwork and review
• 10 min – OPEN Q&A
C O N F I D E N T I A L Apr 19, 2023 3
TOP Priorities and Initiativestill Q2, 2008
C O N F I D E N T I A L Apr 19, 2023 4
Engineering 2008 Top 3 Priorities (aligned)
Priority Description Business Benefit Projects Involved
1Performance, Stability and Security
Improved quality level for all live products with clearly defined monthly or quarterly metrics
Benefiting expansion and renewal
SM, MKV, AM, SMS
2 NPS Scores
Improved usability and functionalities
Benefiting expansion, migration and renewal
UI reskin, Reporting, Search
3 Customer Migration
Migrate customer to single product suite
Benefiting adoption, and creating new offerings, and simplify the support
SM, MKV, AM
Absolutely has to happen – put best effort and team to meet the metrics and dates
C O N F I D E N T I A L Apr 19, 2023 5
Engineering 2008 Top Initiatives
Dedicated effort and close collaboration to deliver
Priority Description Business Benefit Projects Involved
1 Small Meetings SolutionRelaunch Small Meetings Solutions for corporate customers with target of new revenue
SMS, BoP
2 Mid-Market StrategyProviding new products in mid market for new revenue
Meetings.com, BoP
3 Forward ArchitecturePattern, services, process roadmap for our going forward architecture
Architecture roadmap, process and then services
4 QA and Release Automation Reduced missing bugs and release errors by repeatable and automated process
SM, MKV, AM, SMS, BoP
C O N F I D E N T I A L Apr 19, 2023 6
Special Attention – Release Mgmt and SCM
C O N F I D E N T I A L Apr 19, 2023 7
Attendee Mgmt Q2
C O N F I D E N T I A L Apr 19, 2023 8
Technology Strategy and Technology Advisory Board
C O N F I D E N T I A L Apr 19, 2023 9
2008 Engineering Roadmap – Update from 01/2008 Q1Q1 Q2Q2 Q3Q3 Q4Q4
PeoplePeople
TechnologyTechnology
ProcessProcess
SystemsSystems
Many Products Retire one Retire Two Single Suite
A bit agile All Agile All AgileMore Agile
Needs Refactoring Towards ServicesRefactoring Service Centric
Business Inhibitor Key Talents Team Mgmt Business Enabler
C O N F I D E N T I A L Apr 19, 2023 10
Q1 2008
Moving along the curve – from 01/2008
Security
PerformanceStability
Agile
Automation
Architecture
Q2 2008
Security
PerformanceStability
Agile
Automation
Architecture
Q3 2008
Security
PerformanceStability
Agile
Automation
Architecture
Q4 2008
Security
PerformanceStability
Agile
Automation
Architecture
Technology Efficiency Curve
C O N F I D E N T I A L Apr 19, 2023 11
Why – Objectives – Inspirations • salesforce.com
– evolve platform as a service and App Exchange
– database, logic, UI, development as a service
• google / amazon / ebay– a set of web API for developers to build, extend and use google services
• apache– open source project
• What they have in common:– a common set of services offered through web based API
– be able to build, customize or extend existing functionalities
– be able to harvest and manage the intelligent of bigger force
C O N F I D E N T I A L Apr 19, 2023 12
Feature-Rich UIMore features – complexity, but
still usable
Simpler UIFewer features – simple, with very
high usability
StarCite Enterprise
Meetings.com
Occasional Planner
User Experience
Products
Personas
Meetings.comEnterprise
Full-time Planner
StarCite Express
Core Capabilities R
FP
Bu
dg
et
Se
arc
h
Dis
co
ve
ry
Bu
y
Re
gis
tra
tio
n
Pa
y
Bu
sin
ess
Inte
llig
ence
So
cial
N
etw
ork
ing
Ne
go
tia
tio
ns
Co
nte
nt
Mg
t
Le
ad
Mg
t
Ch
an
ne
l M
gt
Ma
rke
tin
g
Yie
ld M
gt
Integration Adapters
Other Channel Systems
Integration Adapters
Feature-Rich UIMore features – complexity, but
still usable
Simpler UIFewer features – simple, with very
high usability
Lead Visibility
Sales Personnel
User Experience
Products
Personas
Group Lead Center
NSO
Chain Systems
Chain Mgt
BU
YE
RS
UP
PIE
RE
NG
INE
C O N F I D E N T I A L Apr 19, 2023 13
Architecture – Service OverviewService Oriented Architecture
Data ServicesMeta DataData ExtensionData Integration
Pro
ce
ss
es
Re
qu
irem
en
t, De
sign
, De
velo
p, T
est, D
ep
loy, S
up
po
rt
Common Business Services
Common Management ServicesLogging Profiling Instrumentation
Control and Intervene
Platform and Infrastructure ServicesData Mgmt Launch Communication Flow Distribution CachingNetworking Servers DB 3rd Party
Common Utility ServicesUnit Test Code Review & Gen
Test automation
Co
mm
on
Se
cu
rity S
erv
ice
sD
esig
n, R
evie
w, A
ud
it, Use
r Mg
mt, E
ncryp
tion
Logic ServicesConfigurationExtensionCustomization
UI ServicesConfigurationExtensionCustomization
Co
mm
on
Inte
gra
tion
Se
rvic
es
Inte
gra
tion
pro
vide
r, con
ne
ctors a
nd
ap
pro
ach
es
Fra
me
wo
rks
, Sta
nd
ard
s, P
atte
rns
, Gu
ide
line
s
Enterprise Products
Meeting Search
Content
Budget Booking
Admin User Reg
RFP
Payment
Reporting
Supplier Products SMB Products
Spend MgmtAttendee
MgmtGLC Private Label meetings.com
C O N F I D E N T I A L Apr 19, 2023 14
Architecture – System Overview
Platform and Infrastructure
Common MgmtServices
Common UtilityServices
RFPBuyer Svc
RFPSupplier Svc
Common IntegrationServices
BookingSvc
Search SvcUser Mgmt
Svc
Spend Mgmt(meetingview.net)
Meetings.comEnterprise
SMBMeetings.com
GLC(supplier.starcite.com)
Private Labelsaccorsales.com
…
Build, Test, Deploy, Configure and Customize with LIVE Services …
…
C O N F I D E N T I A L Apr 19, 2023 15
Summary of Technology Strategy
Technology Direction
Actions Benefits Metrics Transition Risks Risks Mitigation
Service Oriented Architecture (SOA)
SpecializationImproved quality and team skill
Reduced number and impact of bugs
* Extra effort on project collaboration
Stronger project/program mgmt from managers
LayeringReduced risk to customer base
Reduced regression* Extra effort on project collaboration
Stronger project/program mgmt from managers
IsolationImproved scalable with growth and complexity
Increased Feature Velocity
* Challenging refactoring workEvolutionary approachTechnical oversight
Standard APIQuicker new features or products
Increased Feature Velocity
* Incorrect API design Iterative introduction
SimplicityLowered mgmt and maintenance cost
Reduced spending* Requires architectural changes
Iterative removal of complexity
C O N F I D E N T I A L Apr 19, 2023 16
Summary of Technology Strategy (cont’d) Technology
DirectionActions Benefits Metrics Transition Risks Risks Mitigation
Evolutionary roadmap
Business Driven
Closely aligned technology roadmap
Improved *correct* feature counts
* Mis-understood or mis-aligned
Weekly communication and validation internal and external stakeholders
Controlled Managed introduction of new concepts
Better release quality * Mis-judged scopeKeep thin and be conservative at beginning
LeveragedRefactoring and reuse internal and external
Better release qualityIncreased Feature Velocity
* Wrong decision on build vs buy
Never afraid of throwing code out
Organizational Enabler
PM-ENG owners
Joint ownership with PM and ENG managers
Increased Feature Velocity
* Collaboration with PM Localized PM roles
Small TeamNimble, flexible, creative and ownership
Improved *correct* feature counts
* Extra effort on project collaboration
Stronger project/program mgmt from managers
ProcessTeams dedicated to automate
Better release quality *Pulled to multiple directions Stay on this priority
C O N F I D E N T I A L Apr 19, 2023 17
Technical Advisory Board Objectives• Charter:
– Review and advise on key technology decisions
– Introduce best practice
– Help on recruiting
• Members:– James Barrese
• Vice President, Systems Development & Architecture, eBay, Inc.
– Chuck Geiger• Partner, Silicon Valley Product Group
– Barmak Meftah• Senior Vice President, Products and Services, Fortify Software
– Matthew Mengerink• Vice President of Core Technologies, PayPal, Inc
C O N F I D E N T I A L Apr 19, 2023 18
Update of first TAB meeting – 06/12/2008• Summary
– Meeting was very successful - all above objectives are met– Advisors got good understanding of business and products, and appreciate the opportunities and challenges– And they have quite a few past experience to share– Our team also engaged in good discussion on technical and business topics– Agreed on the strategy and direction, will review detailed technology
• Thoughts to share– Agreed on the direction for the following:
• the direction of consolidating, refactoring and leveraging existing code base• the direction of introducing and standardizing platform and architecture services• the top priorities should be data and data related API and ops• evolve and refactor code base with consolidation, specialization and isolation• build common business services starting with standard interface
– Agreed on organization structure will help to lead and enforce technology and architecture strategies– Agreed on proper project ownership will provide incentive to accelerate tasks
– Stress importance of correctly manage common engineering tasks across all products as first order priorities and standardized (not after thoughts):
• security, app administration, user mgmt, internationalization and localization, release and deployment– Stress importance of technically solid content management system with rich content from past experience– Stress importance of clear accountability of each engineering functions
– Suggested enhance the interaction with business, and get team excited with quote from Paypal's president: "if you can not get passion to engineers, they will NOT be fast enough for you"
– Suggested improve QA team's technical skill as general direction
C O N F I D E N T I A L Apr 19, 2023 19
MarketView Q2
C O N F I D E N T I A L Apr 19, 2023 20
Agenda
• Preamble
• Q2 Releases
• Metrics
• Achievements
• Epilogue
C O N F I D E N T I A L Apr 19, 2023 21
Preamble - How did we start Q2?
• Application challenges– Distribution failures
– Server stability
– Performance
• Business Challenges– No new features provided to the users
– Existing functionality not exposed to the suppliers
– Delayed migrations
C O N F I D E N T I A L Apr 19, 2023 22
Preamble - What did we plan for Q2
• Improve Performance and Stability– Monitor / Analyze
– Refactor / Fix / Optimize
– Monitor / Analyze
• Complete UI Migration– Migrate suppliers to view the improved response capabilities
• Start SOM Migration– Start migrating SOM suppliers to MarketView
• Adding new features– No Login RFP
C O N F I D E N T I A L Apr 19, 2023 23
Q2 Releases
MKV8.2.* Performance fixes
SOM migration fixes
PL site migration
Complete
MKV8.3 Accor “No Login RFP” and PL migration
Performance fixes
Complete
UI Migration GLC and Accor supplier migration to the new response forms
Complete
SOM-MKV Migration Migration Started45% Vendors migrated
10% RFPs migrated
0.1% failure rates
On Track
DC Move Savvis Data Center moveMoved to July due to scheduling conflicts for the 6/28 date
Slipped to July
C O N F I D E N T I A L Apr 19, 2023 24
Metrics – RFPs / Responses
C O N F I D E N T I A L Apr 19, 2023 25
Metrics – Failures and Distribution Times
C O N F I D E N T I A L Apr 19, 2023 26
Metrics – Level1s
C O N F I D E N T I A L Apr 19, 2023 27
Metrics - Regressions
C O N F I D E N T I A L Apr 19, 2023 28
Achievements
• 7 sites migrated from G2 to G3
• Increased throughput from Distribution Engine– 90% failure reduction
– 90% improvement in distribution time
• Operations Efficiencies– 65% reduction in Level1
– Reached 0 24+ Support Queue state
– Introduced “Hot Customer Issues” protocol
• SOM Migration– Achieved 0.1% failure rate
• Regressions– Reduced regressions from 33 (start of Q2) to 4 (end of Q2)
C O N F I D E N T I A L Apr 19, 2023 29
Epilogue - How are we going in Q3?
•With a lot of confidence……
C O N F I D E N T I A L Apr 19, 2023 30
Reporting Q2
C O N F I D E N T I A L Apr 19, 2023 31
Reporting Project Update
• Reporting Plan of Record
• Release 1.2 Update
• Risks and Dependencies
C O N F I D E N T I A L Apr 19, 2023 32
Reporting Priorities
• Enable migration of SOM accounts to MV Spend Management by migrating SOM historical data for meeting, vendor, budget and RFP into the warehouse.
• Enable migration of OneForm accounts to MV Spend Management by migrating OneForm historical data for meeting, vendor, budget and RFP into the warehouse.
• Complete replication of budget and RFP data into the warehouse from Spend Management.
C O N F I D E N T I A L Apr 19, 2023 33
Reporting Roll Out Plan
• Reporting 1.2 (6/30/08)– SOM customers can be migrated to SM platform and they can see and report against their legacy data (meetings,
vendors, budget and rfp) in the warehouse.
– SM customers can now use single sign on to login to the reporting system.
– SM customers can also see all the vendors they used in SM in the reporting system.
• Reporting 1.2.1 (7/15/08)– OneForm customers can be migrated to SM platform and they can see and report against their legacy data
(meetings, vendors, budget and rfp) in the warehouse.
– SM charter customers can use standard budget items in ad-hoc reports.
– Bug fixes
C O N F I D E N T I A L Apr 19, 2023 34
Reporting Roll Out Plan
• Reporting 1.3 (8/15/08)– SM charter customers can use custom budget items in ad-hoc reports.
– SM charter customers can use RFP data and responses in ad-hoc reports.
– Enable 2 more SM customers to use the reporting system (detailed SM customer migration plan to be provided)
– Bug Fixes
• Reporting 1.3.1 (8/30/08)– Enable more SM customers to use the reporting system (SM customer migration plan to be provided)
– Bug Fixes
• Reporting 1.4 (9/15/08)– Enable all SM customers to use the reporting system.
– Performance enhancements and more canned reports.
• .
C O N F I D E N T I A L Apr 19, 2023 35
Release Content
Task Status
Meeting, Vendor, Budget, RFP and RFP Response tables defined in DWH
On Track
SOM meeting, vendor, budget and RFP data migrated to data Warehouse
On Track
Cognos models updated for aggregated reporting on budget and RFP data.
On Track
Single Signon from Spend Management to DWH On Track
SM accounts can report against Vendor data On Track
Cognos upgraded to version 8.3 On Track
C O N F I D E N T I A L Apr 19, 2023 36
Reporting 1.2 Update
Type
Analysis and
mapping
Landing Pull
Stage Pull
DWH Pull
Cognos Model
Move to QA
Test Case complete
Test Case Executed
SOM
Meeting n/a
Vendor n/a
Budget
RFP RFP Response
ETL Coding
C O N F I D E N T I A L Apr 19, 2023 37
Reporting 1.2 Update
• Single Sign On– Analysis, design and coding complete
– Testing in progress
• Cognos 8.3 upgrade– Dev upgraded and tested
– QA upgrade and tested
– Stage upgraded on 6/19
C O N F I D E N T I A L Apr 19, 2023 38
Performance testing – Ad-Hoc Reports
C O N F I D E N T I A L Apr 19, 2023 39
Performance testing – Ad-Hoc Reports
C O N F I D E N T I A L Apr 19, 2023 40
Performance Testing – Canned Reports
C O N F I D E N T I A L Apr 19, 2023 41
Outstanding Defects
• 1 P0
• 11 P1s
C O N F I D E N T I A L Apr 19, 2023 42
Risks and Dependencies
• End to End migration testing involves synchronizing SOM, SM, and DWH environments. It has been difficult to use any of the current SOM environment that have representative customer data. All are in use for GLC migration.
• Performance work somewhat delayed due to controller unavailability Need to run tests for 50 and 100 concurrent users.
• Need more customer validation of models exposed in Cognos.
C O N F I D E N T I A L Apr 19, 2023 43
Summer Mobile Challenge
C O N F I D E N T I A L Apr 19, 2023 44
Fun in the summer – StarCite Mobile Challenge
• Why– Have fun while being creative
• Who– All StarCite employees, interns and contractors, NOT just engineering
• When– Now till Sep 1st, at your spare time
• How– Think creative, focus on new ideas to use StarCite on mobile
• Winners– iphones for the winning team
C O N F I D E N T I A L Apr 19, 2023 45
Stock Option Update
C O N F I D E N T I A L Apr 19, 2023 46
C O N F I D E N T I A L Apr 19, 2023 47
Questions?