Permit Pipeline Website
with migration to DataBricks

🏗️ Berkeley Housing Pipeline Dashboard

Features:

• Live Map: All projects color-coded by status

  • 🔴 Proposed (permit submitted)

  • 🟡 In Process (permit approved, under construction)

  • 🟢 Completed (certificate of occupancy issued)

• Pipeline Metrics:

  • Total units proposed vs. completed

  • Average time from proposal to completion

  • Current backlog

• Project Cards:

  • Address, units, status

  • Key dates: Submitted → Approved → Started → Completed

  • Comparison: Proposed units vs. Actual units built

• Timeline View:

  • See projects moving through the pipeline

  • Filter by year, neighborhood, size

Filter by existence of digital twin

Individual Project Model

Add a one-click link to a page that shows Googe Maps, Google streetview, and links to architectural drawings and renderings.

Add links to each inspection report, with name and time and report by inspector.

Add lidar and 2D and 3D images of site visits.

Add water piping model; add thermal model; add power distribution model; add radio frequency and EMF model;

Create digital twin for structural health modeling.

Design migration path to DataBricks

From distributed open access for Berkeley analysts using TinySQL and Datasette models,  to Berkeley Planning professional staff data environment enabling City of Berkeley cross-department digital twin and system modeling

Data we need

📊 Data We Need:

From Berkeley's permit system:

1. Zoning Permits (proposals)

2. Building Permits (approved/started)

3. Certificates of Occupancy (completed)

4. Project design documents

5. Inspection reports

   1. List of reports: 

Tech Stack

🛠️ Tech Stack:

Option A: Simple & Fast (Static Site)

• Frontend: React/Next.js

• Maps: Mapbox or Leaflet

• Hosting: GitHub Pages or Vercel (free!) or Netlify or 

• Data: Updated CSV files

Option B: Dynamic (Database)

• Frontend: Same as above

• Backend: Datasette with Simon Willison's mapping modules, other data journalist modules

• Database: SQLite with automated updates

• Hosting: Fly.io

Extensions to City-wide Digital Twin modeling

• Structures

• Streets

• Subways

• Waste flows

• Elevated rail

• Soils 

  • Water tables / Aquifers

  • Slide zones

  • 
    

• Piping structures

  • Water: EBMUD

  • Gas

  • Telco / Comms / Fiber

  • Conduits

  • Storm water

  • Sewage

• Water usage by structure

• UC Campus 

  • Power

  • Water

  • Sewage

  • Waste

  • Comms

  • Hazardous materials

  • Nuclear plant