+ All Categories
Home > Data & Analytics > SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Date post: 15-Jul-2015
Category:
Upload: keiichiro-ono
View: 532 times
Download: 1 times
Share this document with a friend
Popular Tags:
79
What’s New In Cytoscape? Keiichiro Ono UCSD Trey Ideker Lab Cytoscape Core Team SDCSB Workshop 4/17/2015 @Sanford
Transcript
Page 1: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

What’s New In Cytoscape?

Keiichiro Ono UCSD Trey Ideker Lab Cytoscape Core Team

SDCSB Workshop 4/17/2015 @Sanford

Page 2: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Welcome!- This Section:

- Cytoscape Updates

- Cytoscape and the Web

- Working with External Tools and Cytoscape CI

- Afternoon Sessions:

- Cytoscape Workshops: Beginners & Advanced (1:30PM-3:00PM)

- Cytoscape Clinic (3:00PM-)

Page 3: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Quick Introduction to Cytoscape

Page 4: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

What is Cytoscape?

Page 5: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

An Open Source Platform for Biological Network Data Integration, Analysis and Visualization

Cytoscape

Page 6: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 7: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape- Open Source: LGPL

- Free for both commercial and academic use - Developed and maintained by universities, companies, and research

institutions

- De-facto standard software in biological network research community - 13k downloads / month

- Expandable by Apps - Platform, not a stand-alone desktop application

Page 8: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Real World Use Cases

cytoscape-publications.tumblr.com

Page 9: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Projects

Page 10: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Projects

- Cytoscape 3.2.1

- Cytoscape and Web

- Cytoscape Cyberinfrastructure (CI)

Page 11: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Projects

- Cytoscape 3.2.1

- Cytoscape and Web

- Cytoscape Cyberinfrastructure (CI)

Page 12: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2

Page 13: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2- Latest version of Cytoscape

Desktop application

- New Features:

- Chart Editor

- Export as Web Application

- Performance Improvements

- Lots of bug fixes

Page 14: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2- Latest version of Cytoscape

Desktop application

- New Features:

- Chart Editor

- Export as Web Application

- Performance Improvements

- Lots of bug fixes

Page 15: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Chart Editor

Page 16: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Chart Editor

Page 17: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Chart Editor- Visualize multiple data points

to a single view

- Time series data

- Multiple GO terms

- Chart types: Bar, Box, Pie, Heat Map, Ring

- Part of standard Visual Style Editor

- Everything will be saved into session files

Page 18: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Gradient Editor

Page 19: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2- Latest version of Cytoscape

Desktop application

- New Features:

- Chart Editor

- Export as Web Application

- Performance Improvements

- Lots of bug fixes

Page 20: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Background

Page 21: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Projects

- Cytoscape 3.2.1

- Cytoscape and Web

- Cytoscape Cyberinfrastructure (CI)

Page 22: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape and Web Technologies

Page 23: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

History

Page 24: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

10 Years Ago…

Page 25: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 26: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

2005

- Cytoscape 2.2: a Java Desktop Application

- Google released an application called Google Maps beta

- “Re-discovery” of JavaScript, or Ajax

Page 27: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Today

Page 28: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 29: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Today

- JavaScript is a programming language for serious application

- Web is a competitive application platform

Page 30: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

What should we do?

- Cytoscape should support use cases such as:

- Sharing data over the web

- Visualize network data on the web browser

Page 31: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

cytoscape.js

Page 32: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

- A JavaScript Library

- NOT A WEB APPLICATION!

- For web application programmers

- But there are some web applications using Cytoscape.js

cytoscape.js

Page 33: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 34: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

bit.ly/1JEAaHj

Page 35: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Web Apps using Cytoscape.js

Page 36: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

cynetshareA web application using cytoscape.js

Page 37: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 38: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 39: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

bit.ly/1DNmetV

Page 40: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

bit.ly/1DNmetV- Location of Network File

- Visual Style

- Zoom Level

- Viewable Area

Page 41: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Publication Viewer

Interactive paper figuresCollaboration Project with Elsevier

Page 42: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 43: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2- Latest version of Cytoscape

Desktop application

- New Features:

- Chart Editor

- Export as Web Application

- Performance Improvements

- Lots of bug fixes

Page 44: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Export as Web Application

Page 45: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Export as Web Application

Exporting Cytoscape-generated visualizations as a complete web application using Cytoscape.js

Page 46: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 47: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 48: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium
Page 49: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Demo

Page 50: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape 3.2.1www.cytoscape.org/download.php

Page 51: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Projects

- Cytoscape 3.2.1

- Cytoscape and Web

- Cytoscape Cyberinfrastructure (CI)

Page 52: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape Cyberinfrastructure

Page 53: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Problems in Bioinformatics- No more free lunch

- Even if you buy expensive machines, you cannot get free performance gain anymore. You have to design your code for massively distributed environment. (From Scale-up to Scale-out)

- Complex Data Analysis Pipeline

- Need to build pipeline by connecting multiple resources, or services

- Needs for complex, customized data visualization

- Reproducibility

➡ But building, deploying, and maintaining reproducible pipeline is not straight-forward

Page 54: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Basic Workflow of Data Visualization

Page 55: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Data Preparation

Analysis Visualization

Page 56: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

ALL tools should work nicely together with other popular software packages!

Page 57: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

as a service

Page 58: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

REST

cyREST for Cytoscape-as-a-service

Page 59: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Users

Page 60: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

User Type I- Domain experts

- Average computing skills

- Use Excel as their primary workbench for data analysis

- For them, bioinformatics means using some of NCBI/EBI web tools or DAVID

- Have tons of data not analyzed / visualized yet

- Excel is my friend.

Page 61: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

User Type II- Computational biologists

- Advanced computing skills

- Use Python + SciPy /NumPy, R + Bioconductor, or MATLAB every day

- If necessary, write their own packages

- Use HPC technologies a lot

- Manual operation is evil.

Page 62: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Both of them are Important!- Type I: “Bench Biologists”

- Domain experts

- Data producers

- Type II: Computational Biologists

- Experts of large-scale data analysis

- Especially important for genome-scale data analysis

They are not well supported for a long time in

Cytoscape community…

Page 63: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Requests from Type II Users- I have 200 networks in my session and I need to create

one PDF per view. How can I do it with Cytoscape?

- I need to use igraph for network analysis, but its visualization feature is limited. I want to use Cytoscape as an external visualization engine for R.

- Usually I use IPython Notebook to record my work. How can I integrate Cytoscape into my workflow?

- I want to generate Style for each time point and create small multiples of networks.

Page 64: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

REST

Page 65: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

What is cyREST?

- Platform-independent, RESTful API module for Cytoscape

- In short, you can drive Cytoscape from any programming languages

REST

Page 66: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

REST

Cytoscape 3.1+Clients

POST

PUT

DELETE

GET

Page 67: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Get full network with unique ID 52 as JSON

GET http://localhost:1234/v1/networks/52

Page 68: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cytoscape CyberinfrastructureCytoscape CI: a long-term goal

Page 69: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Cyberinfrastructure?

Page 70: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

–Wikipedia

Cyberinfrastructure:

Research environments that support advanced data acquisition, data storage, data management, data integration, data mining, data visualization and other computing and information processing services distributed over the Internet beyond the scope of a single institution

Page 71: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

?

Page 72: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Computing Infrastructure Community

Page 73: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

App Store

Page 74: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

App Store

- Both Cytoscape and Bioconductor have

- Large user and developer community

- Lots of examples and documents

- Workshops

- Community is equally important as technology for successful CI

Page 75: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Interactive Data Analysis Environments

In-House Databases External Computing Resources

- Graph Layout- Statistical Analysis- Data Pre-processing

RStudio

- NumPy- SciPy- Pandas- NetworkX

IPython Notebook

File / Code Hosting ServicesPublic Data Repository

PSICQUIC Services

EBI RDF Platform

Other Bioinformatics Web Applications / Services

- igraph- rCurl

Command Line Tools

> sed> awk> grep> curl

Web Browsers

Data Repository & Collaboration Service

Data Bus (Internet)

Your Workstation

Cytoscape App Store

Cytoscape Desktop

Apps

Core

REST

Page 76: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

Interactive Data Analysis Environments

In-House Databases External Computing Resources

- Graph Layout- Statistical Analysis- Data Pre-processing

RStudio

- NumPy- SciPy- Pandas- NetworkX

IPython Notebook

File / Code Hosting ServicesPublic Data Repository

PSICQUIC Services

EBI RDF Platform

Other Bioinformatics Web Applications / Services

- igraph- rCurl

Command Line Tools

> sed> awk> grep> curl

Web Browsers

Data Repository & Collaboration Service

Data Bus (Internet)

Your Workstation

Cytoscape App Store

Cytoscape Desktop

Apps

Core

REST→ Service Repository

→ Network Data Repository

Page 78: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

• https://flic.kr/p/bFZpyg

• https://flic.kr/p/bmXUz1

Photo Credits

Page 79: SDCSB CYTOSCAPE AND NETWORK ANALYSIS WORKSHOP at Sanford Consortium

• https://www.flickr.com/photos/23629083@N03/15409436041/in/photolist-ptFotK-9uS2gj-hypkSp-hypk9F-hypjha-99c472-9Xkuuc-huNmqB-7NMxMz-rg2Xh2-qYABcA-qjnGoB-rg2WVF-rdQYMf-qjaxy7-rg5Aoo-rg2Wre-qYAAt1-rg2Wev-qYAAaA-rg2W1V-rdQXT1-qjawtS-rg9ePH-rg5zb3-qjnEtV-qYHAvc-qYBA9d-rg2V7F-qYHAeF-qYAySA-rg5ys9-rg9dLF-rg2Utg-rg9drH-qYAyew-rg9dmc-rg5xP5-rg5xDA-qYAxV5-rg2TLe-rg5xp7-rg5xfQ-aq32tC-hba7em-hbafzE-gbeABq-gck7Dv-7PoYg1-fkisQL

• https://www.flickr.com/photos/nebulux/10000066526/in/photolist-geEXo7-58r1VP-6GioJH-9juEda-53HFiR-4sq7n3-4gyg7e-8ag9VV-8uqK43-4E89Gc-iWDeiJ-9G47M4-9G71KC-9waYuP-5FWSrX-87Mhxi-9G71XY-7Ai8hs-48vd2B-7B7o6n-6D9uWd-6hffXv-gYExNx-7defC1-66ygvB-4LsWSN-6D5n5k-6hfg5z-eucXAh-8uyuuG-aAY6cH-76QCEX-7f6mdp-RntfW-eFuVBC-5nY8Vc-7utTA2-brdj8F-92k6n3-5KdCfh-83uVKy-8unxG8-3d3zxi-cdz8S7-4HT5qQ-99SwEn-7Akbcb-8y7ds9-fvo9zH-9zZky3

• https://www.flickr.com/photos/stratman2/8613731520/in/photolist-e8aChq-7LLUoQ-8s8eBL-6uGRmE-77wKJF-dqo6ar-6hffGK-7rykRT-6fG8WV-8unyFa-8AeF8A-93Xpo2-9XLXCj-7GVMym-5Tu3dJ-7v58RC-5K9nBF-2MbvpL-2M77nV-et54Ce-6hfgvr-6hffQa-67wNj5-9FDGTz-49NmoE-eFXB7u-76QB7H-brdbSP-brcYHT-22zYYv-6fFZoM-ckuXNC-a8UZ3D-dzGXYU-6nf4MN-4j7TzA-47fYur-2kutoV-56catX-apUJgr-cSJHkG-88w1ie-6Nbj1a-8MYxve-6xL3SF-6fL87j-4G6x71-dUL16b-7auq8Q-6hwbVB

• https://www.flickr.com/photos/gcwest/281385801/in/photolist-5mFJtX-4o3Ria-hD9E92-qSbck-9abnoA-7hsWoU-ntEmgy-oSAQtv-nx5Chg-iuZJCa-j7eWKk-hD7JTZ-4iECHX-j8M2r7-bSrWHc-prpFcX-db7xd-jLmzoF-75mqRx-pnSzL-6gVcao-9F5bop-j77HEs-73Umq1-5kRyNp-hD9cR2-mTvNB8-gyXWaf-Lkro7-idQBY4-fRYu1-5eR2cn-3EK4k-nnxH8u-9uDMLx-4NY3Yi-kDQagt-ioGRSb-75qid1-82RzYt-5qQuwt-n8hvL6-ifemz5-3iYUQG-aJnNiX-mzirX2-23rDNy-qx3KEd-h5UnGW-hD7Jqz


Recommended