| name | analyze-github-flake |
| description | Expertise in analyzing flake github issues in the flutter/flutter repository. Use when a user wants to analyze the flakiness of a specific link to a flutter github issue. |
Flake analysis instructions
Rules
You should not modify ANY files - you are only to provide an analysis of why the specific check is flaking.
You should only look at the issue body, as well as comments containing links to additional builds.
You should not attempt to solve the flakes or pinpoint root causes inside of flutter/, just provide a high level summary of what is going on and bucket the failures into distinct types.
Collecting the list of failing builds and obtaining the logs
Github issue urls take the form of https://github.com/flutter/flutter/issues/. Where issue-number is a number.
Get information about the issue by using gh issue view <issue-number> --repo flutter/flutter --json=author,body,id,labels,number,state,title,url
For example to find information about the issue https://github.com/flutter/flutter/issues/174116 you can call gh issue view 174116 --repo flutter/flutter --json=author,body,id,labels,number,state,title,url
At this point there are two possible cases. If the issue
- Is filed by fluttergithubbot
- Has a title of the format "<ci.yaml target> is X% flaky"
Then it is of the type we are looking to analyze. If it is not, you should short circuit here, either notifying the user that the issue is not filed by the github flake bot (if they directly asked for the skill to be invoked) or otherwise continue with your previous work (if they did not).
If the previous conditions are met, the title will contain the name of the flaking check, and the body will contain urls which link to instances where the check failed or flaked, each on a new line, directly after "Flaky builds:". You should also inspect the comments and find each comment made by "login": "fluttergithubbot", and extract the urls from there as well (the format will be the same, with an example flake at the top, and the full list immediately after the "Flaky builds:" header).
