Standard MAISY Energy Use and Hourly Loads Database Detail

 

This page describes detailed characteristics of standard MAISY Utility Customer Energy and Hourly Loads Databases. Click Here to view a summary description of all MAISY Databases including standard, MAISY RECS, Scope 3 Financed Emissions, and EV Charging Databases.

Standard MAISY Utility Customer Database Characteristics Summary


Database Size Database Format
  • 6.7 million Residential Customer Records
  • 600,000+ Commercial Customer Records
  • Each Record (Row) = All Data For an Individual Customer
  • CSV, EXCEL Row/Column Format, or Customized Format
Database Maintenance Raw Data Sources
  • Annual Updates
  • Validated With Utility, Other Information
  • Utility Customer Billing Data, Surveys, Metered Data
  • Utilities, Associations, Government Agencies, Proprietary Surveys
Database Structure Geographic/Segment Options
  • ~ 5% Samples of US Residential & Commercial Utility Customers
  • Accurately Reflects Customer Size, Energy Use, etc. Distributions
  • Customer Weights Support Population Analysis
  • Metro Areas, Utility Service Areas, States, ZIP-Defined Areas
  • Residential Segments: Dwelling Unit Type and Size, Income, kWh/kW, etc.
  • Commercial Segments: Building Type, Size, Employees, kWh/kW, etc.
Energy Use Data Electricity kW Data
  • Annual Whole Building kWh, Natural Gas and Fuel Oil Btu
  • Annual End-use Energy (Heating, Water heating, etc.) for Each Fuel
  • Standard: Whole Building and End Use Hourly and 15-minute kW
  • End-use (water heating, lighting, etc.) load Detail
Non-Energy Data Items Summary kW Load Profile Data
  • Households: Demographics, Income, Appliances, Dwelling unit, etc.
  • Commercial: Square Feet, Operating Hours, Building, Occupancy, etc.
  • 24-Hour Day-type kW Profiles (Weekday, Saturday, Sunday) by Month
  • Customized Summary Data: Monthly Energy, Peak kW, etc.
List of Commercial Database Variables List of Residential Database Variables


Additional MAISY Utility Customer Database Detail

Recent Residential Database Extensions

15-minute load detail are available as an option.

Database Sources/Development/Updating

Data Sources and Reconciliation: MAISY databases are compiled from dozens of data sources including:
  • Individual customer data sources
    • Millions of individual utility customer records
    • Customer records from national, state and utility surveys
    • Psychographic and firmographic data from public and proprietary sources
    • Proprietary data collected by Jackson Associates
  • Population and segment data
  • Dozens of federal, state and local government data sources
  • Utility customer-class and rate-class energy use and hourly load data
MAISY data reconciliation recognizes and adjusts for weather differences, data collection strategies and sample designs, sampling error and other issues that arise in integrating multiple data sources.

The Database Development Process Each database development includes four steps:
  1. Develop current population characteristics and a sample design for the geographic area (ZIP, utility, state, ets.) This step determines the number of utility customers within segment stratum categories such as building type, space heating fuel type, building age, and so on and identifies sample requirements for each stratum required to support deep drill-downs.
  2. Extract a sample of utility customers from the master MAISY database file to populate each survey stratum. Individual record energy use is updated to reflect current energy use characteristics including weather-adjustment to reflect typical weather in the state or utility service area.
  3. Each record contains a population weight that reflects the number of customers it represents in the state or service area population (i.e., a weight of 25 means that this particular customer represents 25 customers in the state, or service area, with the same customer characteristics). Summing weights for a particular segment provides the total number of customers in that segment. The Excel sumproduct formula can be applied to the weight column and other data columns to develop segment totals for that data item. For example, applying a sumproduct formula to the weight and annual kWh column provides total electricity used in the customer segment.
  4. Validate the database with state and utility-provided energy use and customer data.
MAISY Database are continuously updated as new data become available The master MAISY database includes millions of individual utility customer records developed from a variety of public and proprietary sources that are continuously updated. Energy use data are weather adjusted to reflect typical meteorological year (TMY) weather data in the database geographic region(s). 2024 MAISY Utility Customer Databases reflect 2023 customer counts.

MAISY Database Accuracy/Comparison With Other Commercial and Residential Energy Consumption Data Sources

Accuracy: It is not possible to calculate MAISY multi-source statistical data accuracy with classical statistical approaches; however, our experience indicates that variables of primary interest to our clients are typically within a (+/- ) 10 percent confidence interval. These observations are based on applications for utilities where MAISY data have been evaluated against actual utility customers. MAISY databases are validated against a variety of sources including utility energy use and load data, load research data, FERC and EIA filings and more.

Comparison With Other Energy Use and Hourly Loads Data Sources: The only other US data sources drawing on individual utility customer data and encompassing the entire country is the Department of Energy EIA's RECS (Residential Energy Consumption Survey) and CBECS (Commercial Buildings Energy Consumption Survey) surveys.

While CBECS data are useful for some national and regional analysis, small sample sizes, large standard errors, lack of sub-region geographic detail, errors in modeled end-use energy use data, dated information, and limited coverage provide a questionable basis for using these data sources for most market and sales analysis, product development and design and other applications.

For example, While the Department of Energy’s CBECS survey documentation reports 95% confidence intervals of +/- 8 percent for total US commercial buildings electricity consumption for its 2003 survey; drilling down to individual buildings (e.g., office, retail, etc.) yields 95% confidence intervals greater than +/- 25 percent for half of the sixteen building types. Drilling down to smaller geographic areas provides even less accuracy. For example, the 95% confidence interval for major fuels consumption in the West census region is +/- 67% for more than half the sixteen building types (e.g. food sales is +/ 84%). Applying these data means that, for example, food sales fuels consumption likely range is between 0.012 and 1.84 times the CBECS estimate. Drilling down for more detail results in even greater confidence ranges rendering results from these national surveys of limited use for geographic areas smaller than the nation as a whole.

The most recent 2020 RECS (residential) survey (final release, June 2023) has an expanded sample of 18,400+ household records and provides state-level identification of each record. This sample size extension greatly expands the applicability and reliability compared to previous RECS surveys that collected data from approximately 5,000 households. However sample size limitations on drill-down analysis should still be recognized.

A new MAISY Database product (MAISY RECS, introduced in February 2024, extends the RECS database to include household emissions and 8760 hourly whole building and end-use electricity kW loads. Click here to see additional detail on this new MAISY RECS Database. RECS Hourly Databases For applications that require greater segmentation or geographic detail below the state level, the 6.5 million household records and ZIP detail in the Standard MAISY Databases described above support these extended analyses.

The Critical Issue of Sample Size in Drill Down Accuracy Drill-down accuracy of CBECS and RECS survey data is primaqrily a function of the number of sample records in the drill-down segment of interest. CBECS drill-down accuracy declines significantly with just a few drill-down as ~5,000 customer records is sliced and diced. While the 18,400+ record RECS survey sample is almost four times that of CBECS, state-specific samples range from about 300 to 1100 records so state-level drill-down accuracy may also be limited more than realized for state-level analysis.

MAISY Databases provide significantly greater accuracy for drilldowns of more than several layers because of larger sample sizes and greater geographic detail. For example, a special extraction of residential customer records for a major manufacturer provided 50,000 statistically representative customer records for the Los Angeles metropolitan area and the same number for the San Francisco metropolitan area.

By reconciling and integrating a variety of customer data sources, determining population characteristics, and applying a robust sample design, MAISY databases are able to deliver reliable detailed utility customer energy use and characteristics for small geographic areas and detailed customer segment specifications. MAISY data reconciliation recognizes and adjusts for weather differences, data collection strategies and sample designs, sampling error and other issues that arise in integrating multiple data sources.

Hourly-15min-0.5sec loads Caution: Pitfalls Using Department of Energy, OpenEI and NREL energy and hourly load data for utility customer market-oriented analysis

One OpenEI source provides commercial and residential engineering model-based hourly 8760 load results for various weather locations for a limited set of commercial (16) and residential (3) building model input assumptions that typically do a poor job of reflecting the population in any specific area and cannot reflect the diversity of customers in market segments of interest.

NREL has recently completed a large-scale project to provide hourly loads for 14 commercial buildings and 5 residential buildings across the US. The database includes 900,000 hourly load profiles that can be applied to various geographic areas. These data were developed to support detailed energy efficiency & electrification initiatives. Application of these data for most of the analysis promoted by NREL requires significant engineering expertise.

These NREL-derived energy uses and hourly loads data sources are poorly suited to meet the analysis needs of most companies, state agencies and other organizations because they:
  • Provide energy use and hourly loads data for only prototype (i.e., assumed) buildings with assumed physical and occupant characteristics that are unlikely to reflect customer segments of interest
  • Reflect occupancy hourly load data that are assumed to be the same across all individuals
  • Ignore variations in occupant characteristics (e.g., income, floor space, household members), instead assuming average values that prevent important segmentation opportunities
These limited Department of Energy data are free so we understand why some companies start their market information development with these data sources; however, considerable wasted time and costs are typically associated with an attempt to use these data for meaningful market-related information.

    Hourly-15min-0.5sec loads Click Here to see more information regarding cautions using Department of Energy sources and advantages of using MAISY database data.

Hourly Loads Detail

In addition to annual and monthly energy use, equipment, building, operating characteristics and other customer information, MAISY Databases include hourly electric, loads for each customer record. Hourly kW load detail is based on actual metered electricity use data

15-minute electric loads are also available and based on metered electricity use data. As one would expect, 15-minute data shows considerably more variation than hourly data (15-minute loads reflect an average of kW demand over 15 minutes rather than over an hour).

Relationships between 15-minute and hourly loads depend on a variety of factors including the presence of electric space heating, water heating, air conditioning as well as dwelling unit and household characteristics (e.g, number of household members).

15-minute/hourly relationships are illustrated below for two days for a California utility customer with annual electricity use of 10,083 kWh. kW load data are provided for each of the 96 15-minute intervals in the day. The blue lines reflect the hourly kW for each of the 4 15-minute time intervals within each hour. The red lines reflect the 96 15-minute kW loads in the day.
Summer hourly and 15-minute loads Winter hourly and 15-minute loads
Load detail can also be provided as day-type /month summaries (weekday, weekend day, peak day for each of the 12 months) or other time-specified intervals for electric, natural gas and oil energy use.

Load data are weather-adjusted to reflect normal hourly weather data. Users can access and evaluate hourly loads for individual customer records or for any grouping of customers defined by database variables (e.g., heating fuel, business type, square feet, number of children, etc.) The large number of customers in the databases and the database design permits users to develop hourly load information for detailed customer types and market segments based on relevant customer characteristics.

More Detail on 8760 MAISY Hourly Loads Detail and Client Hourly Load Applications

More Detail on MAISY kW Loads (hourly , 15-minute, etc.) and Client Hourly Load Applications

Options for Custom Hourly Loads Databases

MAISY Excel Workbooks

MAISY databases are provided in CSV formats and Excel workbooks. Each individual database record occupies one row of a worksheet. Each column in the row contains a value for a single variable. The right-most columns include either month/day type load profiles or full 8,760 or 15-minute weather-adjusted hourly loads.

Each record contains a population weight that reflects the number of customers represented in the geographic area population (i.e., a weight of 31 means that particular customer represents 31 customers in the geographic area, with the same customer characteristics). Summing weights for a particular segment provides an estimate of the total number of customers in that segment. The Excel sumproduct formula can be applied to the weight column and other data columns to develop estimates of segment totals for that data item. For example, applying a sumproduct formula to the weight and annual kWh column provides total electricity used in the customer segment.

Hourly Load Database

Drilling Down in MAISY Databases

MAISY databases have been developed with over 7 million utility customer records specifically to support energy use and energy-related analysis of user-specified, detailed customer segments (e.g., households in Dallas, single family dwelling units with incomes less than $25,000, small office buildings with electric space heating built before 1980, and so on). This deep drill-down capability is provided by a database sample design that reflects knowledge of our clients' applications.

For example, if the population of customers includes a 10 percent electric space heating saturation, a random sample of 2000 would provide only about 200 electric space heating customers. However, with 20 commercial building types, the confidence interval around building-information would be quite high especially when one drills down to evaluate electric-heated buildings in different size categories.

We know that electric space heating customers are of interest to our clients' applications so we boost the number of electric space heating customers pulled from the master MAISY database to ensure that users can conduct multiple drill downs on electric space heating customers with confidence. We apply the same criteria with other important customer variables. MAISY database record weights automatically adjust for this oversampling” so that total customers, energy use and other customer segment characteristics always correctly reflect population values.

Customer Segment Databases

MAISY Utility Customer Databases can be provided for customer segments of interest. For example, a market analysis focused on the San Francisco market could include customer information on single family owner-occupied homes for customers with incomes of $100,000 or more and annual kwh use of more than 10,000 kWh. Master databases consisting of more than 7 million US utility customers provide more than enough detail to drill down to any client-specified customer segment. Individual utility customer records are extracted, processed and utility customer information is processed to reflect customers within each client-desired customer segment.

Customer segment database information supports new technology product development and market assessment, marketing and sales market sizing and evaluations, and other applications that utilize information on markets and market segments.

In addition to electric load data, additional information is provided for each segment including number of customers and average or typical characteristics of customers in each segment. The table below illustrates typical detail associated with both Commercial and Residential Databases.

Segment definitions (e.g., ranges of floor space, peak kW, annual kWh, household income, geographic areas, etc.) are determined in collaboration with JA clients to meet technology development and/or marketing needs.

Example Questions That Can Be Answered With MAISY Data:
  • How do hourly or 15-minute load profiles vary across customer segments and what are the impacts on product design and system cost?
  • How do customer financial benefits vary across customer segments?
  • Which customer segments should marketing and sales campaigns focus on to offer the greatest customer energy bill savings?
  • What customer characteristics are most closely associated with the greatest energy bill savings?
  • What operational strategy maximizes customer electric bill savings given utility rate structures and incentives?
  • How many potential customers are associated with different customer segments?
  • What are the implications of load profiles on technology performance, control strategies, lifetime, and other operating and maintenance issues?
  • Apply segment-specific load profiles in marketing material targeted to individual segments
  • Apply segment-specific load profiles in direct sales contacts to illustrate operation and economic benefits to prospective customers
  • Scale load profiles using customer annual or monthly energy use to develop customer hourly load estimates
Segment electric load data is provided in Excel Workbooks as illustrated with the Example workbook below, making access and evaluation easy and facilitating data export to other platforms.
Market Segment Workbook

Deciding on Segment Versus Individual Customer Databases

     Segment versus Customer Data - How to determine the best customer information development strategy


MAISY Individual Customer Data Versus "Prototype or Typical" Data

The MAISY system permits users to select individual customers or customer segments based on dozens of customer characteristics. Pick any combination of business type, floor space, operating schedules, space heating fuel, year of construction and many other variables to zero in on a specific customer type or market segment.

What about other load-profiling systems that offer 12, 36 , 75 or some other limited number of fixed customer segments? To represent 13 commercial business types; electric, gas and oil heat; small, medium and large buildings requires 117 prototypes or "typical" buildings. Add in age categories and more than 200 "fixed prototypes" would be required, well beyond the scope of these "fixed" systems. With MAISY, customer and segment selections provide hundreds of possible definitions with nearly unlimited choices of customer characteristics. Only MAISY provides the detail and flexibility required to reflect the extensive, accurate customer and segment detail required in today's energy markets.

Relying on "prototype and typical" is similar to analyzing a "typical" family which consists of two adults and 0.6 children - it may reflect an average but it may also provide misleading results when used to understand customers and markets, to develop programs to fit the needs of individual customer segments, to evaluate the profitability of serving these customers or to evaluate markets for new technologies.

Sources of load profile data which rely on fixed customer segments (e.g. large, medium and small offices) typically develop hourly load data with engineering models (e.g., DOE2, OpenEI, NREL) of a single "prototype" building. The aggregate nature of these representations misses the variation that exists among individual buildings within these segments, hiding important market information. For instance, a particular electric rate structure may provide a competitive profit based on an entire segment's single prototype load profile; however, analysis of subsets of the segment (which can be performed with MAISY but not with the "prototype or typical" load profile approach) may reveal significant diversity in profit levels across customer sub-segments such that some customers are provided power at a loss while profit margins on other customers result in cream-skimming targets for other suppliers.

Similarly, evaluating markets for new technologies or potentials for energy efficiency initiatives requires consideration of the full range of customers within a market or utility service area. The average load profile may reflect little potential hiding the fact that a significant portion of the market with different load characteristics provides great potential. For more information on this topic see Avoiding "Prototype" and Average Load Data Aggregation Errors .

Other MAISY Database Products

     ZIP Area Utility Customer Databases - ZIP-level averages
     Household and Commercial Weather Risk Analysis - Risk assessments