Building a Petabyte Scale Reporting Pipeline on Google Cloud Platform

Kabarak University Library - Student Conference Room, Kabarak University, Nakuru, 20100

Working with pipelines on Google Cloud Platform

Mar 20, 2021, 6:30 – 9:00 AM

18
RSVP'd

RSVP Now

Key Themes

Google Cloud

About this event

Waze for Cities Data allows Waze global public sector partners, mostly municipal officials or traffic departments, to access visualized traffic analysis dashboards with connected-citizen data stored in BigQuery. This program enables over 1,200 partners to access a single dashboard view customized query results to implement better planning. In this session, you will learn how the PSO team worked with Waze to build a data pipeline on GCP using Cloud Datastore, GAE, and GCS to automate ingesting of partners polygon traffic data from BigQuery dataset. We will also show how the ingested data was fed into a Data Studio dashboard to enable user based views and how we implemented centralized billing along with Stackdriver audit log analyzer to measure partner BigQuery usage.

When

When

Saturday, March 20, 2021
6:30 AM – 9:00 AM UTC

Agenda

6:30 AMOverview of GCP
7:00 AMWhat is a production pipeline?
7:30 AMPipeline Tools - Source Control, Build Tools, Configuration Management, Containerization & Monitoring
8:30 AMWaze maps case study - High Level Overview and how we can transfer this knowledge to our projects.

Partners

JetBrains logo

JetBrains

Google Developers logo

Google Developers

Organizers

  • Brayan Kai Mwanyumba

    She Code Africa Nairobi

    GDSC Lead

  • Hope Mwangi

    Co-Lead

  • FELIX MASIGWA MORARA

    Kabarak University

    Cyber Security Co-Lead

  • Francis Mayieka

    AI/ML Co-Lead

  • IVAN TOROITICH BOWEN

    Web Co-Lead

  • ASHIOYA JOTHAM VICTOR

    Data Science Co-Lead

  • Carla cheruto

    Events Co-Lead

  • KIPLAGAT DUKE LIMO

    Design Co-Lead

  • MERCY JEMELI

    Kabarak

    Cyber-Security

  • LENNOX MWITA

    IOT and Robotics Co-lead

  • MAVIN KIPKORIR

    Android Co-Lead

  • DORCAS WAMBUI KAMUNGE

    Content Co-Lead

  • NEWTON MWITA

    Web Co-Lead

Contact Us