What have CAT & DiscoverText done for qualitative methodology?

Stuart Shulman, Texifter

2014 Conference: Past, Present and Future25 years of CAQDAS

Stuart Shulman – Texifter

Pronounced “Tech-Sifter”

Stuart Shulman – Texifter

Circa 1999

Stuart Shulman – Texifter

May 2001Council for Excellence in Government

June 2002National Defense University

Computer Science & NSF Influences:Measure Everything!

Stuart Shulman – Texifter

How fast?How reliable?

How accurate?

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Inter-Rater Reliability is Key

Understanding the landscape of human interpretation better prepares us to face the challenge of machine classification

Stuart Shulman – Texifter

Adjudicate Boundary Cases

Stuart Shulman – Texifter

“CoderRank for Enhanced Machine Learning” is Patent Pending

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Labeling, Tagging, or AnnotationImproves Machine Learning Over Time

Stuart Shulman – Texifter

Iterate Human Coding & Machine-Learning

Stuart Shulman – Texifter

Word Sense Disambiguation (Relevance)

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Stuart Shulman – Texifter

Naturally Occurring Clusters of Free Text Can Be Discovered Automatically

Stuart Shulman – Texifter

Purist

A Spectrum of Methods Approaches

deep immersioncloseness to data

antipathy to numberscredible interpretation

in-depth analysiscontextualsubjective

experimental mixed methodadaptive hybrid

flexible approachinterdisciplinary quantitative

focus on errormeasurement criticalvalidity and reliability

replication & objectivity generalizationhypotheses

PositivistPluralist

• Free and open source software options• Web-based (crowd source) collaborative tools• Measurement innovation• Free and premium social data collection• Random sampling and keystroke coding• Advanced search and filtering• Deduplication and clustering algorithms • Custom machine learning classifiers• Word sense disambiguation • CoderRank for enhanced machine learning

Stuart Shulman – Texifter

What have CAT & DiscoverText done for qualitative methodology?

Stuart Shulman – Texifter

Dr. Stuart W. ShulmanFounder & CEO, Texifter, LLCResearch Associate Professor, UMass AmherstDirector, Qualitative Data Analysis Program (QDAP)Editor Emeritus, Journal of Information Technology & Politics

Contact Informationstu@texifter.comhttp://people.umass.edu/stu/@stuartwshulman

Thanks for Listening!