Searching for SharePoint Analytics

transcript

SEARCHING FOR SHAREPOINT ANALYTICSHOW TO GET INSIGHT ON YOUR INTRANET

Jeff Fried CTO, BA Insight

SharePoint Saturday NYCJuly 2016

THANK YOUEVENT

SPONSORSWe appreciated you supporting the New York SharePoint Community!

• Diamond, Platinum, Gold, & Silver have tables scattered throughout

• Please visit them and inquire about their products & services

• To be eligible for prizes make sure to get your bingo card stamped by ALL sponsors

• Raffle at the end of the day and you must be present to win!

Focused on Search and SharePoint since 2004

Longtime Search Nerd• CTO, BA Insight• Senior PM,

Microsoft• VP, FAST• SVP, LingoMotors

About Jeff FriedPassionate About• Search• SharePoint• Search-driven

applications• Information

Strategy

Blog: BAinsight.com/blogTechnet Column“A View from the Crawlspace”

jeff.fried@bainsight.com

About BA Insight Our software quickly connects SharePoint users to needed information Software portfolio includes:

– Connectivity - Secure connectors and federation to over 50 content systems– Applications - Improve the user experience to boost productivity– Classification - Autotagging, metadata generation, and text analytics– Analytics - Insight into how SharePoint portals, search, & content are being used

Hundreds of successful implementations including:

Analytics Out-of-the-Box Build your own Analytics What else is out there? What’s coming next?

Outline

The Value of Analytics• Continually improve performance and satisfaction

– Improve infrastructural performance– improve your search centre's performance

• Increase user engagement• Validate that SharePoint is delivering results

• Use today's analytics to help drive tomorrows experiences

Layers of Analytics

Infrastructure

Application

Behaviour

Website SharePoint/Intranet

Web services

Page load

People happy?

Servers, Farm

Health checks

How are people using SharePoint

Analytics Out-of-the-Box Build your own Analytics What else is out there? What’s next?

Outline

SharePoint Evolution

SharePoint 2010 AnalyticsWeb Analytics Reports

Traffic reportsSearch reportsInventory reports

These reports aggregated at the following levels: Per web application in the farm Per site collection Per site Per search service application

OoTB these reports are visible to Administrators at each level‘View Web Analytics Data’ Permission Level

SP 2010 – Report Summary

SP 2010 - Traffic ReportsHow much traffic your site gets (Number of Page Views);

Who visits your sites (Top Visitors);

How visitors arrive at your site (Top Referrers);

Daily Unique Visitors

Top Destinations

Top Browsers

SP 2010 - Search ReportsHow many times users searched (Number of Queries)

What were the most used search terms (Top Queries)

What queries have high failure rates (Failed Queries)

Best Bet Usage, Search keywords

SP 2010 - Inventory ReportsWhat is the total disk drive space user (Storage Usage)

How many sites exist (Number of Sites)

Top Site Product Versions

Top Site Languages

SP 2010 – Schedule & Export

SharePoint 2013 Analytics

Popularity Trends shows usage event statistics for a site collection, a site, or an individual item in a library or list.

Most Popular Items shows usage event statistics for all items in a library or list.

SharePoint 2013 Audit Reports

SP 2016

Better statistics on how SharePoint is being used, and how things may failReal time telemetry (latency, 404’s, document usage stats)SLAPI (SharePoint Logging API)

Enhanced usage database (improves *significantly* upon existing usage database)Generates updated report data in real timeStats / Reports on usage, health, storage, performance, and much moreThere’s a lot of useful data in there

Advanced Data Analysis & Reporting

SharePoint Online Reports: Very much like on premises

New usage reports for SharePoint, OneDrive, Yammer and Skype now available

Providing a complete picture across all Office 365 servicesActivity DashboardEmailOffice ActivationsSharePointOneDriveSkype for BusinessYammer

SharePoint Online Analytics

Outline

SharePoint Analytics – Lacking!

• Reports – not Real time• Require Site Admin Access• Lack of Breakdown e.g. by Hour• No OoTB Dash boarding• Custom means Custom

SharePoint Search Analytics

DB´sPropertie

AnalyticsIndexTimer Jobs

Crawler LogsEvents

ConfigurationPowerShell analysisenginepssna

Thank you to Nicki Borrell

Analytics Timer Job for Search Service Application Search Service Application

Microsoft SharePoint Foundation Usage Data Import

Microsoft SharePoint Foundation Usage Data Processing

Usage Analytics Timer Job for Search Application Search Service Application

Analytics Beyond OoTB: SSRS

Analytics Beyond OoTB: Power BI

Custom Solutions with PowerPivot

PowerShell & Custom Code

PowerShell:• Get Usage Report:

– $searchApp.GetRollupAnalyticsItemData …• Get Search Report:

– $searchApp.GetSearchReport …

Thank you to Radu Tut

$searchApp = Get-SPEnterpriseSearchServiceApplication $site = Get-SPSite "{SiteUrl}" $result = $searchApp.GetRollupAnalyticsItemData(1,[System.Guid]::Empty,$site.ID,[System.Guid]::Empty) $result #for a specific date or for a specific month $date = Get-Date "2013-01-18" $result.GetHitCountForDay($date) $result.GetHitCountForMonth($date)

PowerShell:• Get Usage Report:

– $searchApp.GetRollupAnalyticsItemData …• Get Search Report:

– $searchApp.GetSearchReport …

Custom Code:

PowerShell & Custom CodeSPSecurity.RunWithElevatedPrivileges(delegate {

// You can use SPContext.Current.Site.ID if you have HttpContext

using (var site = new SPSite(siteId)) { var context = SPServiceContext.GetContext(site); var searchProxy = context.GetDefaultProxy(typeof(SearchServiceApplicationProxy)) as SearchServiceApplicationProxy; var usageData= searchProxy.GetRollupAnalyticsItemData(1,Guid.Empty,site.ID,Guid.Empty); // process it } });

Thank you to Radu Tut

Outline

How does Delve Analytics differ?

Infrastructure

Application

Behaviour

Delve Analytics

Session SummaryAnalytics Out of the Box

How analytics have changed through the versions of SharePoint 2010, 2013 and SharePoint 2016 - sometimes not for the better

Build your own AnalyticsWhat options are available beyond out-of-the-box reports - building your own, and add-on dashboards and reports

Analytics – What else is out there?Analytics in the Real World

The Value of AnalyticsAnalytics – What’s next?

o Analytics is remarkably valuable• Insight is better than flying blind

o OOB is better than nothingbut it’s (usually) not enough

o You have options to get better analytics• Build: variety of approaches and frameworks• Buy it: several good 3rd-party products

o Get Startedo Watch this space

www.BAinsight.com

Jeff.Fried@BAinsight.com

@jefffried

CONFERENCE MATERIALS

• Slides / Demo will be posted on Lanyrd.com• http://lanyrd.com/2016/spsnyc

• Photos posted to our Facebook page• https://www.facebook.com/sharepointsaturdaynyc

• Tweet Us - @SPSNYC or #SPSNYC• Sign Up for our NO SPAM mailing list for all conference

news & announcements• http://goo.gl/7WzmPW

• Problems / Questions / Complaints / Suggestions• Info@SPSNYMetro.com

• Visit ExtaCloud’s booth for wrist bands!

Scallywag's Irish Pub

508 9th Ave, between 38th & 39th. [6 minutes walk]

Scallywags also serves food.http://www.scallywagsnyc.com/

References

Discontinued features and modified functionality in Microsoft SharePoint 2013Introducing Delve Analytics in Office 365 Introducing Web Analytics in SharePoint 2010New Analytics in SharePoint 2013New usage reports for SharePoint, OneDrive, Yammer and Skype now available

Searching for SharePoint AnalyticsHow to get insight on your Intranet

Jeff Fried CTO, BA Insight

SharePoint Saturday NYCJuly 2016

For More Information• Check out our resources on: www.BAinsight.com

• Reach me via email at: Jeff.Fried@BAinsight.com

• Follow me on Twitter at: @jefffried