Study Copilot for boilerplate code and testing

DraftIdentity and cybersecurityNot specified

Okta engineers used Copilot for routine coding and testing. A study involving 74 survey participants found improved motivation and perceived skills, but no significant change in pull requests, code volume or cycle time. Later results for Claude Code are separate.

Draft: this entry has not yet been human-reviewed. Its summary and extracted facts are AI-assisted. Check the original source before relying on the claims.

For whom

Engineering leaders in medium or large companies; access to development metrics.

Not for

Unsuitable for treating developer satisfaction as proof of higher organizational output.

Brain Score

5/10 brain cells
Impact
0/2
Evidence
1/2
Reproducibility
1/2
Maturity
2/2
Reach
1/2

Five values from 0 to 2. The total has a minimum of 1. A reading aid based on the source, not an independently measured performance result. How the score works

Original source

The efficiency-throughput gap: Rethinking engineering output in the age of AI 
Type
Blog
Published
Data as of
2026-10-31

The data date records when this dataset was included in the collection. It is separate from the publication date of the source.

Tools

All use cases