What's Next for Data and AI - October 2023

Interconnect Data and AI

• Too many systems to handle all—BigQuery
• New:
  • BigQuery Object Tables
    • Object storage in BigQuery
    • Run AI/ML over
  • Iceberg
  • BigQuery Omni
    • AWS, Azure, Google Cloud
    • Cross cloud materialised views and cross cloud joins—without moving data
  • Dataproc (Spark) + BigQuery + Google Distributed Cloud
    • Regulated on-prem workloads

Bring AI to Your Data

• BigQuery ML
• New:
  • Call LLMs directly from BigQuery
    • e.g. Sentiment analysis, generate new features, knowledge extraction
  • BigQuery feature tables and vector embeddings
  • BigQuery Studio
    • Write SQL, Python, Spark
    • No additional infrastructure
  • BigQuery Data Frames
    • Pandas
  • BigQuery integration with Colab

Boost Data Team Productivity

• Duet AI
  • Code assist
  • Code generation
  • Legacy transformation
• Duet AI + Dataplex
  • Understand data using natural language
• Duet AI + Looker
  • Build visualisations using natural language