Data Analytics Platform Services Request for Information (RFI)

Silicon Valley Clean Energy (SVCE) is seeking information on data analytics platform services to expand its current cloud-based data warehouse (DAISY 1.0) into a more robust platform (DAISY 2.0) that will support data warehousing, data analytics, and reporting needs. DAISY 2.0 will serve as a central, secure repository of data with proper ETL systems and will enable efficient, high-impact analyses and reporting via integrated applications and tools. The platform should support four levels of insight: Descriptive (current state), Diagnostic (how current state was achieved), Predictive (what will happen), and Prescriptive (what should be done). Core functionalities needed include data storage, ETL of SVCE/PG&E/Calpine/other datasets (weather data, CAISO market data, third-party program data, resource and physical asset data, air quality data), data warehousing, data visualization with mapping capability, dashboards, reports, customizable user access permissions, ability to create custom tables, integration with third-party applications and standard tools (Excel, Tableau), query library and version control, and data provenance tracking. Key Applications to integrate include: Load forecasting (short-term day-ahead/week-ahead and long-term aggregate load forecasts), Load shape analysis and load disaggregation, Precision program design and targeting, Customer segmentation, Virtual power plant (VPP) management, and Public-facing dashboard creation. Secondary Applications include Evaluation/Measurement/Verification (EM&V), DER forecasting, and DER/electrification adoption models. Enabling Tools should include geocoding, spatial analysis, address standardization, weather normalization, Python integration, and R integration. The platform must support four user tiers with customizable access permissions: Tier 1 (view/explore shared dashboards/reports), Tier 2 (use/extract insights from specific applications), Tier 3 (perform ad hoc queries, create visualizations, conduct strategic analyses), and Tier 4 (oversee data cleaning/ingestion, create custom tables, manage dashboards/reports). Support requirements include hosting/managing/maintaining SVCE's instance on GCP or similar cloud-based platform, managing data security measures, managing integrated applications/tools, developing/maintaining ETL data pipelines (ingesting datasets daily to monthly), developing/managing core tables/dashboards/reports/map layers, onboarding/supporting staff, managing user roles/access permissions, and mitigating/resolving platform issues. Respondents are encouraged to include innovative components beyond those scoped in the RFI.