Skip to content

Add Pester CI Analysis Skill#26806

Merged
TravisEz13 merged 7 commits into
PowerShell:masterfrom
TravisEz13:ci-failure-skill
Feb 13, 2026
Merged

Add Pester CI Analysis Skill#26806
TravisEz13 merged 7 commits into
PowerShell:masterfrom
TravisEz13:ci-failure-skill

Conversation

@TravisEz13
Copy link
Copy Markdown
Member

@TravisEz13 TravisEz13 commented Feb 13, 2026

  • Add troubleshooting guide for analyzing Pester test failures
  • Add automated Pester test failure analysis script and update documentation

PR Summary

This pull request adds comprehensive documentation to clarify Pester test outcomes and improve troubleshooting for test failures. The main changes include a new guide detailing the meaning of each Pester test status and best practices for writing "working" tests, as well as a reference for parsing stack traces and debugging regex extraction issues.

Pester Test Status Documentation:

  • Added .github/instructions/pester-test-status-and-working-meaning.instructions.md with detailed explanations of Pester test statuses (Passed, Failed, Error, Pending, Skipped, Ignored), what constitutes a "working" test, pitfalls of pending tests, recommended testing patterns, and a checklist for validating tests.

Stack Trace Parsing Reference:

  • Added .github/skills/analyze-pester-failures/references/stack-trace-parsing.md describing supported stack trace formats, regex patterns for extracting file and line information, troubleshooting common parsing failures, and guidelines for adding new output formats to the parser.

PR Context

PR Checklist

@TravisEz13 TravisEz13 added the CL-Tools Indicates that a PR should be marked as a tools change in the Change Log label Feb 13, 2026
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request adds comprehensive Pester test failure analysis capabilities to the repository, including documentation, automation scripts, and guidance materials to help developers troubleshoot failing tests in CI.

Changes:

  • Adds a new "analyze-pester-failures" skill with complete documentation and a 6-step automated workflow
  • Creates an automation script to systematically analyze PR test failures by fetching test results, parsing errors, and generating recommendations
  • Provides reference documentation for understanding Pester stack trace formats and debugging parsing issues
  • Adds instructional guidance on Pester test statuses and what constitutes a "working" test
  • Updates .gitignore to exclude analysis output directories

Reviewed changes

Copilot reviewed 4 out of 5 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
.gitignore Adds pattern to ignore pester-analysis-* directories generated by the analysis script
.github/skills/analyze-pester-failures/scripts/analyze-pr-test-failures.ps1 New automated script that performs systematic 6-step analysis of Pester test failures in GitHub PRs
.github/skills/analyze-pester-failures/references/stack-trace-parsing.md Reference documentation explaining Pester stack trace formats and regex parsing patterns
.github/skills/analyze-pester-failures/SKILL.md Main skill documentation defining the analysis workflow and troubleshooting approaches
.github/instructions/pester-test-status-and-working-meaning.instructions.md Instruction file clarifying Pester test statuses and defining what makes a test "working"

Comment thread .github/skills/analyze-pester-failures/scripts/analyze-pr-test-failures.ps1 Outdated
Comment thread .github/skills/analyze-pester-failures/scripts/analyze-pr-test-failures.ps1 Outdated
Comment thread .github/skills/analyze-pester-failures/scripts/analyze-pr-test-failures.ps1 Outdated
Comment thread .github/skills/analyze-pester-failures/SKILL.md Outdated
Comment thread .github/skills/analyze-pester-failures/scripts/analyze-pr-test-failures.ps1 Outdated
@TravisEz13 TravisEz13 requested a review from Copilot February 13, 2026 19:18
@TravisEz13 TravisEz13 marked this pull request as ready for review February 13, 2026 19:19
@TravisEz13 TravisEz13 requested a review from a team as a code owner February 13, 2026 19:19
@TravisEz13 TravisEz13 enabled auto-merge (squash) February 13, 2026 19:23
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 1 comment.

Comment thread .github/skills/analyze-pester-failures/SKILL.md
@TravisEz13 TravisEz13 merged commit 08b13f2 into PowerShell:master Feb 13, 2026
42 checks passed
@TravisEz13 TravisEz13 deleted the ci-failure-skill branch February 13, 2026 19:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CL-Tools Indicates that a PR should be marked as a tools change in the Change Log

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants