| name | performance-scorecard |
| description | Performance scorecard design, post-matter feedback collection, QBR preparation, and firm comparison for in-house legal ops teams evaluating outside counsel. Design a scorecard framework calibrated to your team's maturity level. Produce post-matter feedback forms for supervising attorneys to complete at matter close. Prepare a QBR pack with agenda, data summary, and talking points for structured business reviews. Produce a side-by-side firm comparison for panel decision-making. Trigger on: 'design a performance scorecard', 'how do we evaluate our firms', 'build us a scorecard', 'post-matter feedback form', 'feedback at matter close', 'collect feedback on the firm', 'QBR', 'quarterly business review', 'prep for the firm review', 'what should I raise with the partner', 'compare the firms', 'which firm is performing better', 'rank our panel', 'firm performance data', 'scorecard framework', 'evaluate outside counsel', 'annual firm review', 'how are our firms performing'. |
performance-scorecard
Description
Performance scorecard design, post-matter feedback, QBR preparation, and firm comparison for in-house legal ops teams managing outside counsel relationships. Build a scorecard framework with quantitative and qualitative criteria calibrated to your team's maturity level. Produce post-matter feedback forms for supervising attorneys to complete at matter close. Prepare a QBR pack — agenda, period data summary, and firm-facing talking points — for structured business reviews. Produce a comparative firm scorecard for panel decision-making. Trigger on: 'design a performance scorecard', 'how do we evaluate our firms', 'build us a scorecard', 'post-matter feedback form', 'QBR', 'quarterly business review', 'prep for the firm review', 'compare the firms', 'rank our panel', 'evaluate outside counsel', 'annual firm review'.
What This Skill Does
Produces the operational tools for evaluating outside counsel performance — the scorecard framework, the feedback forms, the QBR preparation materials, and the comparative data structures that inform panel decisions. Encodes the methodology for collecting, aggregating, and acting on firm performance data across the full relationship lifecycle.
This skill does NOT:
- Review individual invoices for billing compliance — use invoice-review-compliance (OCM Skill 6)
- Design the panel structure or define selection criteria — use panel-design-selection (OCM Skill 2)
- Run the periodic panel review or manage firm exit processes — use panel-review-rationalisation (OCM Skill 8)
- Produce the original matter instruction that sets performance expectations — use matter-allocation-instruction (OCM Skill 5)
Cross-skill connections:
- Invoice compliance records from Skill 6 (billing adherence rate, rejection history) are direct input to the quantitative scorecard criteria in Mode 1 and Mode 4.
- Post-matter feedback from Mode 2 is the trigger that matter-allocation-instruction (Skill 5) identifies at matter close.
- Accumulated scorecard data from Modes 1–4 feeds panel-review-rationalisation (Skill 8) for the periodic formal panel assessment.
- Historical scorecard data from Mode 4 informs RFP evaluation criteria in rfp-pitch-management (Skill 3).
Pre-flight — Confirm and Fill
Gather what you have. Fill in what's known. Use placeholders for the rest. Proceed immediately.
Billing and performance data: Search project knowledge and Google Drive for any existing scorecard data, performance reports, billing summaries, or e-billing exports before running any mode. If data exists, reference it directly. If no data is found, build from the user's stated inputs and label all benchmarks as defaults.
Maturity calibration: Outside counsel management functions operate across three maturity levels (ACC framework). The skill calibrates outputs to the stated level:
- Early — no formal evaluation process; ad hoc firm relationships; manual invoice review; work for simple criteria and Excel-based scorecard
- Intermediate — preferred firms; some billing data from e-billing platform; informal feedback; ready for structured QBR and annual scorecard
- Advanced — full e-billing analytics; structured QBRs; per-matter feedback; dashboard reporting; ready for integrated metrics and competitive benchmarking
| Field | Value |
|---|
| Company / Legal department | [Company] |
| Maturity level | Early / Intermediate / Advanced |
| Panel size (number of firms) | [Number] |
| E-billing platform | [Platform name] / None — manual |
| Primary practice areas | [List] |
| Review period / cadence | [Annual / Quarterly / Per-matter] |
| Firm(s) in scope | [Name(s)] — for Modes 2, 3, 4 |
Routing:
- Building or redesigning a scorecard framework → Mode 1: Scorecard Design
- Collecting feedback after a matter closes → Mode 2: Post-Matter Feedback
- Preparing for a scheduled QBR with a firm → Mode 3: QBR Preparation
- Comparing two or more firms for panel decisions → Mode 4: Firm Comparison
- "Build us a scorecard" / "How do we evaluate our firms?" / "We've never formally reviewed our panel" / "Design a performance framework" → Mode 1
- "Post-matter feedback form" / "Feedback at matter close" / "Attorney feedback survey" / "How do we collect feedback on the firm?" → Mode 2
- "QBR" / "Quarterly business review" / "Prep for the firm review" / "What should I raise with the partner?" / "Firm review meeting next week" → Mode 3
- "Compare the firms" / "Which firm is performing better?" / "Rank our panel" / "Firm comparison for the GC" / "Side-by-side scorecard" → Mode 4
All documents produced as .docx files unless the user requests otherwise. Include Company Name, Firm Name (where applicable), and date in every document header.
Mode 1: Scorecard Design
Produce a Performance Scorecard Framework and a GC Implementation Note immediately — start with the Scorecard Framework. Do not produce a bullet list of criteria, a narrative overview of performance management principles, or conversational commentary before producing the documents. Do not ask clarifying questions before producing the documents. Do not end the response with a question. A user asking "build us a scorecard", "how do we evaluate our firms", "design a performance framework", "we've never formally reviewed our panel", or "what criteria should we use?" is requesting a Scorecard Framework and a GC Implementation Note — produce both documents immediately using the templates below. Calibrate the scorecard to the stated maturity level — Early produces a simplified 5-criterion framework; Intermediate produces the full 10-criterion framework with weighting; Advanced adds dashboard integration guidance and benchmarking notes. Build from what the user has provided. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory. Do not withhold the GC Implementation Note pending additional information — produce it with placeholders where data is missing. The documents are the response.
Input
Maturity level, panel size and composition, available data sources (e-billing platform, matter management system, spreadsheet), preferred review cadence, any existing criteria or priorities. Minimum viable input is a maturity level and a rough panel description.
How to run this mode
- Produce the Performance Scorecard Framework — populate the quantitative criteria table, the qualitative criteria table, the scoring methodology, the performance tier definitions, and the consequence framework. Calibrate depth to stated maturity level.
- Produce the GC Implementation Note — purpose, what the scorecard measures, implementation sequence, and decision to approve.
- Observations and follow-up questions come after both documents. Do not end the response with a question. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory.
Performance Scorecard Framework template
[Company] — Outside Counsel Performance Scorecard Framework
Prepared by: Legal Operations
Date: [Date]
Review cadence: [Annual / Quarterly / Per-matter]
Panel in scope: [Number of firms / named firms if stated]
Maturity calibration: [Early / Intermediate / Advanced]
Purpose: Structured evaluation framework for assessing outside counsel performance against defined criteria. Outputs inform panel retention decisions, work allocation, rate negotiations, and relationship management.
Part 1 — Quantitative Criteria
Data sourced from e-billing platform, matter management system, or spreadsheet. Collected by Legal Operations.
| # | Criterion | Weight | Data source | Scoring method | Notes |
|---|
| Q1 | Budget adherence (actual vs. estimated spend) | [15%] | E-billing / matter records | % variance — <10% = 5; 10–20% = 3; >20% = 1 | Flag late notification of overrun separately |
| Q2 | Billing compliance rate (OCG adherence per invoice review) | [15%] | Invoice review records | % of invoice lines approved without flag — >95% = 5; 90–95% = 3; <90% = 1 | Pull from invoice-review-compliance records |
| Q3 | Timeliness (matter delivery against agreed timeline) | [10%] | Matter records | % milestones on time — >90% = 5; 75–90% = 3; <75% = 1 | Weight higher for time-sensitive practice areas |
| Q4 | Invoice submission timeliness | [5%] | E-billing / AP records | % invoices submitted within OCG window — >95% = 5; 85–95% = 3; <85% = 1 | Standard window: 60–90 days post-period |
| Q5 | Staffing ratios (partner/associate/paralegal mix) | [5%] | Timekeeping data | Within agreed parameters = 5; minor variance = 3; significant variance = 1 | Calibrate to agreed staffing plan |
Early-stage teams: use Q1 and Q2 only. Intermediate: use Q1–Q4. Advanced: use all five plus supplementary metrics (diversity statistics, AFA outcomes, volume discount achievement).
Part 2 — Qualitative Criteria
Collected via in-house attorney survey at matter close or annually. Legal Operations aggregates and scores.
| # | Criterion | Weight | Collection method | Scoring scale | Notes |
|---|
| L1 | Communication and responsiveness | [15%] | Attorney survey | 1–5 (1 = consistently poor; 5 = consistently excellent) | Covers turnaround, accessibility, clarity of updates |
| L2 | Quality of legal advice and work product | [20%] | Attorney survey | 1–5 | Core criterion — highest weight for substantive matters |
| L3 | Business alignment (understanding of client goals and commercial context) | [10%] | Attorney survey | 1–5 | Firm demonstrates awareness beyond the immediate instruction |
| L4 | Budget management and financial transparency | [5%] | Attorney survey | 1–5 | Proactive notification of variances; cost-conscious behaviour |
| L5 | Overall recommendation (would engage this firm again for this type of matter?) | [---] | Attorney survey | Yes / Yes with reservations / No | Directional indicator — not weighted in composite score |
Early-stage teams: use L1, L2, and L5 only. Intermediate: use all five. Advanced: add criteria for innovation/technology use, D&I performance, and value-add contribution.
Part 3 — Scoring Methodology
Composite score calculation:
- Quantitative score: weighted average of Q1–Q5 scores (scale 1–5) × combined quantitative weight ([50%])
- Qualitative score: weighted average of L1–L4 scores (scale 1–5) × combined qualitative weight ([50%])
- Composite score: sum of weighted quantitative and qualitative scores (scale 1–5)
Portfolio benchmarking: Where two or more firms operate in the same practice area, rank scores within the group. Portfolio benchmarks are more defensible than market benchmarks — they reflect what peers actually achieved on comparable matters.
Part 4 — Performance Tier Definitions
| Tier | Score range | Label | Description |
|---|
| 1 | 4.5–5.0 | Top Performer | Exceeds expectations consistently |
| 2 | 3.5–4.4 | Meets Expectations | Performing to standard |
| 3 | 2.5–3.4 | Requires Improvement | Performance gaps identified; improvement plan required |
| 4 | Below 2.5 | Exit Review | Sustained underperformance; formal review initiated |
Part 5 — Consequence Framework
Performance tiers carry defined consequences. Be prepared to follow through — scorecards without consequences have no credibility.
| Tier | Consequence |
|---|
| Top Performer | Preferred status for strategic matters; rate increase requests considered; expand panel scope; recognition at annual review |
| Meets Expectations | Continued allocation; standard rate review process; no formal action |
| Requires Improvement | Reduced work allocation pending improvement; formal improvement plan with measurable targets; review in 6 months |
| Exit Review | Formal notice of concerns issued; panel status under review; no new matter allocations pending outcome |
GC Implementation Note template
[Company] — Scorecard Implementation Note
To: [General Counsel / Legal Leadership]
From: Legal Operations
Date: [Date]
Re: Outside Counsel Performance Scorecard — Approval to Implement
Purpose: This note summarises the proposed performance scorecard framework for outside counsel evaluation and seeks approval to implement.
What the scorecard measures:
[2–3 sentences. Reference the criteria from the Framework — quantitative and qualitative. Name the data sources.]
What the scorecard does not measure:
[1–2 sentences. E.g., The scorecard does not assess individual matter-level legal strategy or judge tactical decisions within litigation. It measures delivery performance, financial transparency, and the working relationship.]
Resources required to run this scorecard:
[Legal Operations time estimate — annual administration. E-billing data pulls. Attorney survey distribution. Review cadence agreed.]
Implementation sequence:
- GC approval of criteria and weightings — [date]
- Communicate framework to panel firms — [date]
- First data collection cycle — [date range]
- First scorecard results and consequence review — [date]
Decision required: [Approve / Approve with amendments / Defer]
Reference framework — maturity calibration
Early-stage implementation note: A simple framework consistently applied outperforms a sophisticated framework inconsistently applied. Early-stage teams should use Q1 + Q2 (quantitative) and L1 + L2 + L5 (qualitative) with equal weighting. The value is in establishing the habit and building the data set — not in precision at this stage.
The fundamental problem with performance feedback (from industry data): 70–80% of performance feedback has zero ROI — the vast majority of feedback time doesn't result in better firm behaviour. The scorecard is only as useful as the consequences it carries and the discipline with which results are communicated to firms. The GC Implementation Note is a commitment document, not just a planning tool.
Mutual feedback: Best practice is two-way evaluation — the firm rates the client relationship as well. Include a firm feedback slot in the QBR agenda (Mode 3). Issues the in-house team may not be aware of (unclear instructions, slow approvals, budget surprises from the client side) surface through mutual review.
Mode 2: Post-Matter Feedback
Produce a Matter Feedback Form and a Feedback Collection Note immediately — start with the Matter Feedback Form. Do not produce a list of suggested questions, a narrative description of what good feedback looks like, or conversational commentary before producing the documents. Do not ask clarifying questions before producing the documents. Do not end the response with a question. A user asking "post-matter feedback form", "feedback at matter close", "attorney feedback survey", "how do we collect feedback on the firm?", or "can you produce a form for the team to fill in?" is requesting a Matter Feedback Form and a Feedback Collection Note — produce both documents immediately using the templates below. Calibrate the form to the matter type and team size stated. Build from what the user has provided. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory. If the firm's name has been provided in the user's input in this session, use it in the internal Feedback Form — this is an internal document. Do not withhold the Feedback Collection Note pending additional information — produce it with placeholders where data is missing. The documents are the response.
Input
Matter details — firm name, matter type, approximate duration, budget performance, team size. Minimum viable input is a firm name and matter type. More context (specific issues, team composition, budget performance) allows the form to be calibrated to the actual situation rather than generic criteria.
How to run this mode
- Produce the Matter Feedback Form — calibrated to the matter type, covering the five Brightflag criteria plus matter-specific questions. Include a numerical rating scale and qualitative comment fields for each criterion.
- Produce the Feedback Collection Note — cover note for legal ops to circulate with the form, including response tracking and how results feed the annual scorecard.
- Observations and follow-up questions come after both documents. Do not end the response with a question. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory.
Matter Feedback Form template
[Company] — Matter Feedback Form
Firm: [Firm name]
Matter: [Matter name / number]
Matter type: [Practice area / transaction / dispute]
Matter period: [Start date — close date]
Completed by: [Attorney name and title]
Date completed: [Date]
Please rate each criterion on a scale of 1 to 5. Add qualitative comments in the space provided — specific examples are more useful than general assessments.
Rating scale: 1 = Consistently below expectations | 2 = Often below expectations | 3 = Met expectations | 4 = Often exceeded expectations | 5 = Consistently exceeded expectations
Criterion 1 — Communication and Responsiveness
Rating: [ 1 | 2 | 3 | 4 | 5 ]
Questions to consider: Were emails and calls returned within the agreed timeframe? Were updates provided proactively or only when requested? Was communication clear and appropriately calibrated to the audience?
Comments: _______________
Criterion 2 — Quality of Legal Advice and Work Product
Rating: [ 1 | 2 | 3 | 4 | 5 ]
Questions to consider: Was the advice technically sound and well-reasoned? Were documents well-drafted and requiring minimal revision? Did the firm flag issues you hadn't anticipated?
Comments: _______________
Criterion 3 — Business Alignment
Rating: [ 1 | 2 | 3 | 4 | 5 ]
Questions to consider: Did the firm understand your business objectives and the commercial context of the matter? Did advice reflect an awareness of your risk appetite and operational constraints, or was it generic legal advice that could apply to any client?
Comments: _______________
Criterion 4 — Budget Management and Financial Transparency
Rating: [ 1 | 2 | 3 | 4 | 5 ]
Questions to consider: Was the initial budget estimate accurate? Were variances flagged proactively before they became significant? Did the firm demonstrate cost-conscious behaviour (appropriate staffing, not over-researching, not gold-plating)?
Comments: _______________
Matter-Specific Questions
[Populate based on matter type — examples below. Delete those not applicable.]
Timeline and delivery: Did the matter complete within the agreed timeline? If not, what caused the delay and how did the firm manage it?
Comments: _______________
Team composition: Was the team appropriately composed for the work (right seniority, right specialisms, consistent personnel)?
Comments: _______________
[For transactions] Transaction management: Did the firm manage the transaction process effectively — counterparty negotiations, coordination of workstreams, closing logistics?
Comments: _______________
[For disputes] Litigation management: Did the firm keep you informed of strategic options and their implications? Were court deadlines managed reliably?
Comments: _______________
Overall Assessment
Overall rating (1–5): [ ]
Would you engage this firm for this type of matter again?
[ ] Yes — without reservation
[ ] Yes — with specific reservations (describe below)
[ ] No — describe reason below
Reservation or reason: _______________
Anything else to note: _______________
This form is for internal use only. Results are aggregated by Legal Operations for performance review and panel management purposes.
Feedback Collection Note template
[Company] — Matter Feedback Collection Note
To: [Supervising attorneys — list names]
From: Legal Operations
Date: [Date]
Re: Post-Matter Feedback — [Firm name] / [Matter name]
Why we're asking: Performance feedback collected at matter close produces more reliable and specific data than annual surveys. Your input directly informs how we allocate future work, negotiate rates, and manage the firm relationship.
What to complete: The attached Matter Feedback Form covers five criteria. Ratings take approximately 10 minutes. Comments are optional but significantly increase the value of the data — specific examples are more useful than general observations.
Deadline: [Date — typically 5 business days from matter close]
How to submit: [Email to legal.ops@[company].com / via [platform]]
How results are used: Legal Operations aggregates responses from all attorneys who worked on the matter. Aggregated scores (not individual responses) feed the firm's annual performance scorecard. Individual responses are not attributed. Where patterns indicate a significant issue, Legal Operations may follow up before the annual review.
Reference framework — feedback timing and design
Post-matter is the gold standard: Per-matter feedback is more reliable than annual surveys because the experience is fresh and the assessment is specific. Annual feedback is too late and too abstract to drive behaviour change. The practical challenge is burden — supervising attorneys are time-constrained. Keep the form under 15 minutes to complete.
The feedback-consequence loop: Feedback only changes behaviour when it is shared with the firm and tied to commercial consequences. Collecting feedback without communicating results to the firm has no ROI. The Mode 3 QBR is where the feedback loop closes — results are shared, discussed, and agreed actions recorded.
Collecting feedback from the firm: Best practice is two-way evaluation. Include a request for the firm's feedback on the client relationship in the matter close process — responsiveness to instructions, clarity of scope, billing approval timelines. Issues the in-house team may not be aware of (late approvals, unclear instructions) surface here.
Mode 3: QBR Preparation
Produce a QBR Pack and an Internal Briefing Note immediately — start with the QBR Pack. Do not produce a bullet list of topics to cover, a summary of issues for the meeting, or conversational commentary before producing the documents. Do not ask clarifying questions before producing the documents. Do not end the response with a question. A user asking "prep me for the QBR", "quarterly business review with [firm]", "what should I raise?", "firm review meeting", "I have a meeting with the partner next week", or "prepare talking points for the firm" is requesting a QBR Pack and an Internal Briefing Note — produce both documents immediately using the templates below. The QBR Pack is a structured operational document — agenda, period data summary, and firm-facing talking points — not a list of bullet points. The Internal Briefing Note is the separate pre-meeting document for GC or legal leadership. Build from what the user has provided. Partial data is expected — populate what is available and flag gaps in the data summary with [Data pending] rather than declining to produce the documents. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory. If the firm's name has been provided in the user's input in this session, use it in the internal Briefing Note — this is an internal document. Do not withhold the Internal Briefing Note pending additional information — produce it with placeholders where data is missing. The documents are the response.
Input
Firm name, review period, available performance data (spend vs. budget, billing compliance rate, matter volume, staffing observations, previous scorecard scores), any specific issues to raise, and the objective for the meeting. Minimum viable input is a firm name and review period.
How to run this mode
- Produce the QBR Pack — the document sent to the firm in advance or used to structure the meeting. Includes agenda, period data summary table, and firm-facing talking points for each agenda item.
- Produce the Internal Briefing Note — internal pre-meeting document for GC or legal leadership. Covers pre-meeting context, recommended outcomes, red lines, and internal consensus needed before the meeting.
- Observations and follow-up questions come after both documents. Do not end the response with a question. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory.
QBR Pack template
[Company] — Quarterly Business Review
Firm: [Firm name]
Review period: [Date range]
Date: [Meeting date]
Participants: [Company: Legal Ops lead + GC / legal leadership] | [Firm: Relationship partner + key team]
Prepared by: Legal Operations
Agenda
| # | Item | Time | Lead |
|---|
| 1 | Matter volume and portfolio review | [15 min] | Legal Ops |
| 2 | Spend and billing compliance | [15 min] | Legal Ops |
| 3 | Performance against scorecard criteria | [20 min] | Legal Ops / GC |
| 4 | Value-adds, innovation, and forward collaboration | [10 min] | Firm |
| 5 | Forward agenda — upcoming matters, pipeline, agreed actions | [10 min] | Joint |
Total time: [70 min]. Adjust as needed.
Period Data Summary
| Metric | Period result | Prior period | Commentary |
|---|
| Matters handled | [Number] | [Number] | [Any significant volume changes] |
| Total spend | [Amount] | [Amount] | [Trend — up / stable / down] |
| Spend vs. budget | [Amount] / [% variance] | [Prior variance] | [Over / under; notification timeliness] |
| Billing compliance rate | [%] | [%] | [Improvement / deterioration; key issue types] |
| Invoice submission timeliness | [%] | [%] | [Within OCG window] |
| Staffing composition | [P/A/PA split] | [Prior split] | [Within agreed parameters?] |
| Post-matter feedback score | [Score] | [Score] | [Aggregate; note trend] |
| Outstanding issues from prior QBR | [List] | — | [Resolved / open] |
[Data pending] = data to be populated before or during the meeting.
Talking Points by Agenda Item
Item 1 — Matter volume and portfolio review
Open: [Summarise the period's matter profile. Acknowledge volume changes. Frame the review as a partnership discussion, not an inspection.]
Key points to cover:
- [Matter types handled this period — what shifted, what was new]
- [Any matters outside the firm's usual scope — flag for panel-design discussion]
- [Upcoming matters in pipeline — give the firm forward visibility]
Questions for the firm: [What's your capacity picture for the next quarter? Are there resource constraints we should know about?]
Item 2 — Spend and billing compliance
Open: [Reference the period data summary. Be direct on variances. Frame as data, not accusation.]
Key points to cover:
- [Budget variance — quantify and explain. If overrun: note whether notification was timely or late.]
- [Billing compliance rate — reference specific issue patterns if present (block billing, rate violations, staffing swaps)]
- [Improvement or deterioration from prior period — acknowledge improvement explicitly]
Questions for the firm: [What has changed on your billing procedures since we last raised [issue]? What are you doing differently to improve compliance?]
Item 3 — Performance against scorecard criteria
Open: [Share aggregated scorecard results. If post-matter feedback scores are available, share the aggregate — not individual responses. Frame as "here is what your team's experience has been."]
Key points to cover:
- [Strengths — acknowledge what's working. Be specific.]
- [Areas requiring improvement — be direct. Name the criterion, give an example, state what you need to see change.]
- [Consequence implication if tier has changed — reference the consequence framework without being adversarial]
Questions for the firm: [What's your view on the feedback? Are there factors on your side that explain the pattern?]
Item 4 — Value-adds, innovation, and forward collaboration
Open: [Invite the firm to lead this item. Good firms will come prepared. Poor firms will improvise — note the difference.]
Key points to raise if the firm does not: [CLE or training for the team; secondment availability; technology use on our matters; process improvement opportunities; D&I data on our matters]
Item 5 — Forward agenda and agreed actions
Agreed actions to confirm: [List — firm actions, company actions, joint actions, owner, deadline]
Next QBR date: [Date]
Internal Briefing Note template
[Company] — QBR Internal Briefing Note
INTERNAL — NOT FOR DISTRIBUTION
Firm: [Firm name]
Meeting date: [Date]
Prepared by: Legal Operations
For: [GC / Legal Leadership]
Purpose of this meeting: [1–2 sentences. Is this a routine review, an issue-driven escalation, a rate renegotiation precursor, or a panel retention decision checkpoint?]
Pre-meeting context:
What's going well: [2–3 bullet points. Acknowledge genuine strengths — enter the meeting with a balanced position.]
What needs to change: [2–3 bullet points. Specific, evidence-based. These are the issues you need the firm to acknowledge and commit to addressing.]
Carry-forward from prior QBR: [What was agreed last time? Was it delivered?]
Recommended outcomes from this meeting:
- [Specific outcome — e.g., "Firm acknowledges billing compliance rate has declined and commits to improvement plan with 90-day target"]
- [Specific outcome — e.g., "Agreement on budget notification trigger: firm notifies at 75% of agreed budget"]
- [Specific outcome — e.g., "Rate increase request deferred pending compliance improvement in Q2"]
Red lines — what is non-negotiable:
[List what cannot be conceded in this meeting. E.g., "Do not agree to a rate increase until compliance rate returns to >95%." "Do not commit to new matter allocation until staffing violations are resolved."]
Internal consensus needed before the meeting:
[Confirm agreement with GC on: consequence tier, any rate position, whether a formal improvement plan is required, whether panel status is under review]
Talking point if the firm challenges the data: [Pre-draft a response. E.g., "These figures are drawn from our e-billing platform and invoicing records. If you believe there is a discrepancy, please provide your records and we will reconcile before the next QBR."]
Reference framework — QBR design principles
QBR standing structure (from Brightflag and Legal.io community best practice): Matter volume review → Spend and billing compliance → Performance against criteria → Value-adds and innovation → Forward agenda. This sequence is deliberate — start with facts (volume, spend) before performance judgments, so the data establishes a common baseline before the more sensitive conversation about quality.
Mutual review: The QBR is most valuable when it is genuinely two-way. The firm should be invited to share feedback on the client relationship — responsiveness, clarity of instructions, budget approval speed, matter management practices. Issues the in-house team may not be aware of surface here. If the firm doesn't offer this, ask.
Frequency reality: The typical cadence is annual formal review with quarterly pulse checks. Quarterly QBRs are best practice for high-spend or strategic relationships. Monthly check-ins are appropriate during difficult matters or post-remediation periods.
Mode 4: Firm Comparison
Produce a Comparative Scorecard Table and a Selection Recommendation Note immediately — start with the Comparative Scorecard Table. Do not produce a narrative description of the firms, a summary of available data, or conversational commentary before producing the documents. Do not ask clarifying questions before producing the documents. Do not end the response with a question. A user asking "compare the firms", "which firm is performing better", "rank our panel", "side-by-side scorecard", "firm comparison for the GC", or "who should I allocate this matter to?" is requesting a Comparative Scorecard Table and a Selection Recommendation Note — produce both documents immediately using the templates below. The Comparative Scorecard Table must work with partial data — where data is unavailable for a criterion, use [Data gap] in the cell and list the gaps after both documents with a note on how to fill them. Do not decline to produce the comparison because data is incomplete. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory. Named firms may appear in the internal Comparative Scorecard Table and the internal Recommendation Note — both are internal documents. Do not withhold the Selection Recommendation Note pending additional information — produce it with the data available. The documents are the response.
Input
List of firms to compare, available scorecard data per firm (sparse is acceptable — the comparison works with whatever is provided), and the decision context (panel retention review, matter allocation decision, rate review, annual panel assessment). Minimum viable input is a list of firm names and the decision context.
How to run this mode
- Produce the Comparative Scorecard Table — firms as columns, scorecard criteria as rows, available data populated, gaps flagged with [Data gap]. Include a composite score row (where calculable) and a performance tier row for each firm.
- Produce the Selection Recommendation Note — summary of findings, recommended tier and action per firm, basis for recommendation.
- List data gaps after both documents with a note on how to fill them. Observations and follow-up questions come after both documents. Do not end the response with a question. Use [Company] in all document headers unless the company name has been explicitly stated in the user's input in this session — do not substitute names from session context or account memory.
Comparative Scorecard Table template
[Company] — Firm Comparison Scorecard
Date: [Date]
Prepared by: Legal Operations
Decision context: [Panel retention review / Matter allocation / Rate review / Annual assessment]
Firms compared: [Firm A] | [Firm B] | [Firm C] | [add columns as needed]
Review period: [Date range]
| Criterion | [Firm A] | [Firm B] | [Firm C] |
|---|
| Quantitative | | | |
| Budget adherence (score 1–5) | [Score] | [Score] | [Data gap] |
| Billing compliance rate | [%] / [Score] | [%] / [Score] | [Data gap] |
| Matter delivery timeliness | [Score] | [Data gap] | [Score] |
| Invoice submission timeliness | [Score] | [Score] | [Data gap] |
| Staffing ratio compliance | [Score] | [Score] | [Score] |
| Qualitative | | | |
| Communication / responsiveness | [Score] | [Score] | [Score] |
| Quality of advice | [Score] | [Data gap] | [Score] |
| Business alignment | [Score] | [Score] | [Data gap] |
| Budget management / transparency | [Score] | [Score] | [Score] |
| Overall attorney recommendation | [Yes / Yes w. reservations / No] | [Yes] | [Yes w. reservations] |
| Summary | | | |
| Composite score (where calculable) | [Score / 5] | [Score / 5 — partial] | [Score / 5 — partial] |
| Performance tier | [Tier 1–4] | [Tier — provisional] | [Tier — provisional] |
| Prior period tier | [Tier] | [Tier] | [Tier] |
| Tier trend | [Stable / Improving / Declining] | [Stable / Improving / Declining] | [Stable / Improving / Declining] |
[Data gap] = data not available in current session. See data gap list below both documents.
Selection Recommendation Note template
[Company] — Firm Comparison: Selection Recommendation
INTERNAL
Date: [Date]
Prepared by: Legal Operations
For: [GC / Legal Leadership]
Decision context: [Panel retention review / Matter allocation / Rate review]
Summary of findings:
[3–5 sentences. Name the firm(s) performing at each tier. Identify the principal differentiator between firms — what the comparison data shows. Note data gaps that may affect the reliability of the comparison.]
Recommended action per firm:
| Firm | Current tier | Recommended action | Basis |
|---|
| [Firm A] | [Tier] | [Retain / Retain as preferred / Allocate primary / Watch / Improvement plan / Exit review] | [2-sentence basis] |
| [Firm B] | [Tier] | | |
| [Firm C] | [Tier] | | |
Recommended action classification:
- Retain as preferred — top tier; first allocation consideration for in-scope matters; rate review requests to be given serious consideration
- Retain — meets expectations; standard allocation; no formal action required
- Watch — performing adequately but trend is concerning; increased monitoring; no expanded allocation pending next review
- Improvement plan — below expected tier; formal plan with measurable targets; reduced allocation; 6-month review
- Exit review — sustained underperformance; formal notice of concern; no new matter allocations pending outcome; panel removal process initiated if no improvement
Data gaps affecting this comparison:
[List data gaps per firm — what is missing, what it would affect, and how to fill it before the next review.]
Caveats: [Note where partial data has limited the reliability of a firm's score. Flag any comparison between firms in different practice areas — direct score comparison is less valid where the matter mix differs significantly.]
Decision required: [Approve recommendations / Amend before approval / Defer pending data collection]
Reference framework — scorecard comparison principles
Portfolio benchmarks outperform market benchmarks: Where two or more firms operated on comparable matters in the same period, rank scores within the group. Portfolio benchmarks are harder for firms to argue with — "we're above the market benchmark" is deflectable; "you were the lowest-performing firm in your peer group on budget adherence" is not.
Data gaps are normal, especially at Early and Intermediate maturity: A comparison with partial data is better than no comparison. The comparison table makes gaps visible and creates the discipline to fill them before the next review. Flag gaps explicitly rather than averaging around them.
Tier trend is more important than absolute score: A firm that has moved from Tier 3 to Tier 2 in a single period is a better signal than a firm static at Tier 2. Trend shows whether the relationship is moving in the right direction; absolute score shows where it currently sits.
The comparison drives the consequence, not the narrative: The Selection Recommendation Note is a decision document. The GC should be able to read the recommended action per firm and approve or amend it. Avoid lengthy narrative that buries the recommendation — state the action first, then the basis.
Domain Knowledge
The ACC maturity framework — why it matters for skill calibration
The ACC defines three maturity stages for external resource management. The skill's outputs calibrate to these stages because the same framework applied to an Early-stage team as an Advanced team will produce an unusable output — either over-engineered for where they are, or insufficiently rigorous.
Early stage signals: majority of work directed to law firms on an ad hoc basis; no formal panel; relationships managed by frontline counsel; limited invoice review; no dashboards; no formal evaluation process. A performance scorecard for this team is a 5-criterion Excel sheet they will actually use — not a weighted 10-criterion dashboard that requires e-billing data to populate.
Intermediate stage signals: preferred firm arrangements in place; some e-billing data; dedicated legal ops resource; informal feedback processes; learning what AFAs work. This team is ready for structured QBRs and an annual scorecard but needs to build the feedback discipline from scratch.
Advanced stage signals: centralised OCM function; systematic QBRs; per-matter feedback; dashboard reporting; data-based decision-making in selection and pricing. This team has the infrastructure for sophisticated benchmarking and needs the scorecard to generate reportable GC-level metrics.
Quantitative vs. qualitative — the distinction that matters
Most in-house teams either over-index on quantitative data (spend, billing compliance) or rely entirely on qualitative impressions. The scorecard's value is in combining both systematically.
Quantitative criteria (billing, timeliness, budget adherence) are objective and extractable from e-billing systems. Their limitation: they measure efficiency and compliance, not quality. A firm that delivers all invoices on time and within budget but gives consistently poor legal advice will score well on quantitative criteria alone.
Qualitative criteria (communication, advice quality, business alignment) capture what matters most to in-house counsel but are harder to aggregate and easier to rationalise away. The solution is a numerical rating scale with mandatory comment fields — not open-ended questions that produce free-text responses Legal Operations cannot aggregate.
The five Brightflag criteria (communication, quality of advice, business alignment, budget adherence, overall recommendation) are calibrated to the most common in-house counsel complaints and produce a manageable data set per matter. These are the minimum viable qualitative set.
QBR design and the five standing items
QBRs produce value only if they are structurally consistent across firms and periods. Ad hoc meetings produce ad hoc outcomes. The five standing items — matter volume review → spend and billing compliance → performance against criteria → value-adds and innovation → forward agenda — establish a cadence that firms internalise and prepare for.
Matter volume review first establishes the context for everything that follows. Spend and compliance discussions are more productive when both sides have agreed on what the matter portfolio looked like in the period. Performance criteria discussions are more credible when grounded in specific matters. Value-adds are more meaningful when linked to actual matters rather than generic firm positioning.
Forward agenda last ensures the meeting ends with agreed actions rather than open observations. The QBR is only as useful as the commitments it generates — and commitments require a named owner and a deadline.
The feedback-consequence loop — why most scorecards fail
Industry data indicates 70–80% of performance feedback has zero ROI. The most common failure mode: feedback is collected, not shared with the firm, not tied to commercial consequences, and not referenced in future allocation or rate decisions. The scorecard becomes a compliance exercise rather than a management tool.
The teams getting the most value from performance management are using scorecard results to drive work allocation in real time — top performers get strategic matters; middle performers get standard allocation; bottom performers see volume reduce. The GC Implementation Note in Mode 1 is a commitment to this consequence framework, not a planning document.
The BigLaw partner resistance pattern (from Legal Evolution research): When presented with scorecard frameworks, senior partners often respond: "If there's a problem, I'd rather have a phone call." The resistance is real — partners dislike the accountability that comes with structured data. The response is not to abandon the scorecard but to explain what it provides that the phone call doesn't: a systematic record of performance that removes relationship-based rationalisation and enables fair comparison across firms.
Cross-skill data flows
| Data generated by | Used in performance-scorecard |
|---|
| invoice-review-compliance (Skill 6) | Billing compliance rate and rejection records feed Q2 and Q3 quantitative criteria |
| matter-allocation-instruction (Skill 5) | Matter close trigger activates Mode 2 post-matter feedback |
| engagement-terms-billing-guidelines (Skill 1) | OCG requirements define the compliance benchmark for quantitative criteria |
| performance-scorecard (this skill) | Scorecard data feeds panel-review-rationalisation (Skill 8) |
| performance-scorecard (this skill) | Comparative scorecard data informs rfp-pitch-management (Skill 3) evaluation criteria |
End of skill.
