Skip to content

docs: emphasize some points on what makes a good audit #10376

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Mar 30, 2020
Merged

Conversation

connorjclark
Copy link
Collaborator

@connorjclark connorjclark commented Feb 25, 2020

@connorjclark connorjclark requested a review from a team as a code owner February 25, 2020 05:50
@connorjclark connorjclark requested review from paulirish and removed request for a team February 25, 2020 05:51
@@ -8,13 +8,33 @@ Lighthouse audits that surface in the report should be:
- Contribute significantly towards making the mobile web experience better for end users.
- Not have a significant impact on our runtime performance or bundle size.
- Something that is new, and not something that is already measured by existing audits.
- Important for our strategic goals as a product.
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is another way to say "we have veto control on what lands in core", which goes without saying. low-value to have here.

Copy link
Member

@paulirish paulirish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is great stuff.. a few suggestions and one idea for screenshots.

| `'thumbnail'` | Image Resource | same as above, but we show a thumbnail |
| `'link'` | - | arbitrary link / url combination |
| `'text'|'ms'|'numeric'` | - | |

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i kinda think it'd be cool to have a screenshot or two of examples. in two screenshots (*images and tap-targets) you be able to show off thumbnails, url, numeric, node.

oh i guess one more for source-location.

but showing kinda whets the appetite :)

- Not use 3rd party APIs for completing the audit check.

## Actionable

1. When failing, specific advice should be given. If an audit can fail in multiple ways, each way should have a specific error message.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i dont think its an "error message" because that indicates a runtime problem with the audit.

i dont know what the right words are but.. "users should understand the specifics of why this case is failing"

- Not use 3rd party APIs for completing the audit check.

## Actionable
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actuallly... lets put this actionability section in the plugins.md. that has a bigger audience than this doc. we can of course add a link from new-audits to the section.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I already added a link from the plugin doc -> new audit doc. I don't think this file should exist if we put important new-audit advice elsewhere. weird bifurcation imo

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have two docs for two "conceivable" audiences:

  • audience who wants to build a plugin full of their own audits
  • audience who wants to propose a new audit to core (but doesnt want to implement as a plugin)

The actionability stuff is relevant to both of them.

I'm just saying the 1st audience is bigger than the second. Really I think this actionability stuff is a Must-read for both audiences but i'd rather the plugin folks see it. The risk is greater for them; they could end up making a useless audit. Whereas the proposers just need us to provide feedback to improve their proposal.

The new-audit doc still stands on its own afterwards.

i'm happy to do it if you'd rather not spend the time. (though i would like to convince you its better this way. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants