Skip to content

gogitguhan/hands-on-lab-neo4j-and-vertex-ai

 
 

Repository files navigation

hands-on-lab-neo4j-and-vertex-ai

Neo4j is the leading graph database vendor. We’ve worked closely with GCP Engineering for years. Our products, AuraDB and AuraDS are offered as managed services on GCP. Neo4j Enterprise Edition, which includes Graph Database, Graph Data Science and Bloom is offered in the Google Cloud Marketplace.

In this hands on lab, you’ll get to learn about Neo4j and GCP Vertex AI. The lab is intended for data scientists and data engineers. We’ll walk through deploying Neo4j and Vertex AI on GCP in your own GCP account. Then we’ll get hands on with a real world dataset, building a machine learning pipeline that takes advantage of features generated using Neo4j Graph Data Science to improve prediction in GCP Vertex AI. You’ll come out of this lab with enough knowledge to apply graph feature engineering to your own datasets.

We’re going to analyze the quarterly filings of asset managers with $100m+ assets under management (AUM). These are regulatory filings made to the Securities and Exchange Commission’s (SEC) EDGAR system. We’re going to show how to load that data from a GCP Cloud Storage bucket into Neo4j. We’ll then explore the relationships of different asset managers and their holdings using the Neo4j Browser and Neo4j’s Cypher query language.

Finally, we’ll use Neo4j Graph Data Science to create a graph embedding from our data, export that out, and run supervised learning algorithms in GCP Vertex AI. We’ll try to predict what holdings asset managers will maintain or enlarge in the next quarter.

If you’re in the capital markets space, we think you’ll be interested in potential applications of this approach to creating new features for algorithmic trading, understanding tail risk, securities master data management and so on. If you’re not in the capital markets space, this session will still be useful to learn about building machine learning pipelines with Neo4j and GCP Vertex AI.

Venue

These workshops are organized onsite in a GCP office.

Duration

3 hours.

Prerequisites

You'll need a laptop with a web browser. Your browser will need to be able to access the Google Cloud Console and port 7474 on a Neo4j deployment running in GCP. If your laptop has a firewall you can't control on it, you may want to bring your personal laptop.

If you have an GCP account with permissions that allow you to invoke Vertex AI, deploy from Marketplace and create a Cloud Storage bucket, then you can use that. If not, we'll walk you through creating a GCP account.

Agenda

Part 1

Part 2

  • Lecture - Moving Data (10 min)
    • LOAD CSV
    • Apache Beam and Google Dataflow
    • Apache Spark and Google Dataproc
    • Apache Kafka and Cloud Cloud
  • Lab 3 - Moving Data (15 min)
    • A Day of Data
    • A Year of Data
  • Lab 4 - Exploring Data 15 min)
    • Pandas
    • Cypher Queries
    • Vizualization with Neo4j Bloom
  • Break (10 min)

Part 3

About

Hands on Lab for Neo4j and Vertex AI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%