Comparing Occupant Self-Assessed Behaviour to Actual Metered Consumption
Bibliographic record
Abstract
A post-occupancy evaluation (POE) is a comprehensive building performance review that includes occupant surveys and provides feedback on the overall success of a building design in addressing end-‐user requirements. In doing so, POE often identifies disparities between expected and actual energy usage patterns. Part of determining the source of these disparities is the evaluation of tenant responses. Since these are heavily dependent on the users’ ability to accurately recall their usage patterns, their potential inaccuracy may misinform building retrofits and future projects. This study seeks to compare occupant self-‐assessed behaviour to actual metered consumption. A recently retrofit multi-‐unit residential building (MURB) and Tower Renewal pilot project was selected for the evaluation, and access to the electricity consumption of the pilot was obtained from building management. The project has 146 units, each approximately 20.5m A post-‐retrofit survey has been carried out, which amongst other factors attempted to collect information on small appliances and electronics and their use. 48 valid samples were obtained. The monthly electricity consumption of each unit has been calculated based on the tenant responses, and these values have been compared to actual consumption values from the electronic meters. The average estimated consumption was found to be 45% more than the average metered consumption, with 46% of the survey-‐based estimates exceeding their respective metered readings by more than 50%. As many as 86% of tenants whose consumption estimate exceeded 50% of the metered value incurred time overestimation, while 23% incurred statistical bias. It was also found that all tenants who incurred statistical bias also incurred time overestimation. While individual estimates tend to disagree with metered data, large-‐sample assessments may still be possible. Mode-‐based assessments help to limit sources of discrepancy by eliminating tenant responses that occur infrequently, thus creating sample cases that resemble the contents of a ‘typical unit’. However, great care must be taken to avoid introducing further bias. To this end, more rigorous statistical analysis is required. It is recommended that future surveys avoid overestimation by arranging time-‐related questions in a manner that allows quick revision, tightening the ranges for usage questions to minimize assumptions made, and including relevant custom-‐made questions that either clarify questions for the tenants or minimize ambiguity in the results.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.004 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".