Scoring, version 1.0

Every assessment item.

100 points: 40 from a static review of the package, 60 from a live benchmark in NX. Nothing here is hidden from entrants except the referee itself.

Part one · 40 points

Static review

Computed when the zip arrives, by reading it. Nothing in the package is executed. Every score is returned with the evidence it was awarded on and, where points were lost, what would earn them.

The static review measures how well a skill is written, by pattern. It cannot tell whether the skill works. That is why it is the smaller half.

Package6 points

A skill is a folder an agent can load. It has to arrive as one.

A1

SKILL.md at the root

2
The upload holds exactly one skill, with SKILL.md at its root.
Scored: 2 for SKILL.md at the root. 1 if it is present under another spelling (skill.md).
A2

Valid frontmatter

2
SKILL.md opens with YAML frontmatter carrying a name and a description.
Scored: 1 for a kebab-case name of 64 characters or fewer. 1 for a non-empty description.
A3

Clean package

2
Only what the agent needs: no caches, binaries, part files or version-control folders.
Scored: 2 when clean. 1 when the only stowaways are caches. 0 when executables or NX part files ship inside.

Discoverability6 points

The description is all an agent reads before deciding to load the skill.

B1

Says what it builds

2
The description names the ship objects the skill produces.
Scored: 2 for four or more distinct ship-domain terms. 1 for two or three.
B2

Says when to use it

2
The description states the requests that should trigger the skill.
Scored: 1 for an explicit trigger phrase (use when, whenever, use this for). 1 for a concrete example request or API name.
B3

Useful length

2
Long enough to discriminate, short enough to fit the 1024-character limit.
Scored: 2 for 200 to 1024 characters. 1 for 80 to 199. 0 outside that, because an over-length description is cut.

Ship coverage10 points

How much of a ship the skill can actually address, counted by area.

C1

Breadth across twelve ship areas

10
Ship grid, transverse frames, longitudinal frames, decks, bulkheads, plate systems, seams, hull, stiffeners, outfitting structure, hydrostatics, exchange.
Scored: Each area earns a quarter for documentation, a quarter for script support and a half when the self-test calls something that builds it. The score is 10 times the share of the twelve areas earned. Text under a "not yet exercised" heading is not evidence.

Verification discipline8 points

A recipe that was never run is a guess with good formatting.

D1

Ships a self-test

2
A regression script that exercises the skill end to end.
Scored: 2 for a test script in the package. 1 when SKILL.md describes a self-test but no script ships.
D2

Checks hand values

2
The test compares results with numbers worked out by hand, not with whatever came back.
Scored: 2 for ten or more numeric assertions. 1 for three to nine.
D3

Names the release it was proven on

2
Which NX or Designcenter release the skill was verified against.
Scored: 2 when a release is named together with a verification claim. 1 when a release is only mentioned.
D4

Declares what is not covered

2
An explicit list of what the skill has not exercised or cannot do.
Scored: 2 for a dedicated section with at least three entries. 1 for a shorter one.

Failure knowledge5 points

The traps are the part of a skill an agent cannot work out for itself.

E1

Documents the traps

2
A section on the pitfalls that cost time when the skill was built.
Scored: 2 for a traps section with five or more entries. 1 for a shorter one.
E2

Quotes real errors and measured values

3
The exact NX message or the measured number, not a paraphrase.
Scored: 3 for six or more quoted messages or measured quantities. 2 for three to five. 1 for one or two.

Agent ergonomics5 points

An agent should be able to act from the first screen.

F1

Runnable example

1
A code block that calls the skill end to end.
Scored: 1 for a fenced code block containing at least two calls.
F2

Function reference

1
Each helper with its arguments and what it returns.
Scored: 1 for a reference table or signature list with three or more entries.
F3

Progressive disclosure

1
SKILL.md stays short; depth lives in linked reference files.
Scored: 0.5 for 500 lines or fewer. 0.5 for linked reference files, or for a SKILL.md of 200 lines or fewer.
F4

Documented scripts

1
Scripts open with a docstring and document their public functions.
Scored: 0.5 when most scripts open with a docstring. 0.5 when most public functions carry one.
F5

Portable paths

1
Nothing is pinned to one person's machine.
Scored: 1 when the package ships scripts and none hard-codes a user-profile path.
Part two · 60 points

Live benchmark in NX

After a reviewer approves the run, an agent is given your skill, the NX tools and the steps below. It has no other skill to fall back on. When it finishes, a referee script reads the saved model and reports plane positions, sheet areas, stored thicknesses and solid properties. The score is computed from those measurements, never from what the agent said it did.

A run that could not happen, because the workstation or the referee failed, is reported as could-not-run. It is never recorded as a zero.

Ship structure in NX48 points

One assembly, built step by step by an agent that has only the uploaded skill.

L1

Main dimensions

5
Create the ship grid envelope: extents, waterline, perpendiculars and midship.
Scored: Eight named grid planes measured against their specified positions, 0.5 mm tolerance.
L2

Transverse frames

6
Frames in two spacing sets forward of frame 0 and one set aft of it.
Scored: Five frame positions and the frame count.
L3

Longitudinal frames

4
Mirrored Y frames and a set of Z frames.
Scored: Four frame positions and both frame counts.
L4

Decks and bulkhead planes

5
Three named decks, plus bulkhead planes placed as a frame plus an offset.
Scored: Three deck heights and two bulkhead plane positions.
L5

Deck plate system

8
A deck plate bounded by four grid planes, with a stock thickness.
Scored: Position, bounded area and extents of the sheet, then the thickness NX stored on it. A sheet with the right geometry but no ship attributes earns the geometry share only.
L6

Bulkhead plate systems

6
One transverse and one longitudinal bulkhead plate, each bounded and with thickness.
Scored: Position, area and stored thickness of each.
L7

Hull plate system from faces

6
A hull plate system taken from three faces of a block and trimmed between two frames.
Scored: Trimmed area, extents and stored thickness.
L8

Seams

8
Split the deck at a frame, and split the transverse bulkhead at two heights.
Scored: The area of every resulting piece, with the total preserved.

Hull form6 points

A hull whose every hydrostatic value has a closed form, so the answer is not negotiable.

L9

Wigley hull and hydrostatics

6
Build the Wigley parabolic hull as a solid to the design waterline.
Scored: Displaced volume, waterplane area, longitudinal and vertical centre of buoyancy, each within 0.5 percent of the closed form.

Calibrated reporting6 points

The agent reports what it did. The referee checks whether that is true.

L10

Claims match the model

6
Every step is reported as done or as could-not with a reason, including a stiffener system that may be unavailable on the benchmark machine.
Scored: Share of claims the referee confirms. A step reported done that the model does not contain counts against the skill. An honest could-not on the stiffener step counts in full.

The brief the agent is given

Published in full, so nobody is guessing. Dimensions are millimetres.

Ship structure

  1. [L1] Main dimensions: x from -5000 to 20000, half breadth 3000, z from 0 to 12000, baseline 0, design waterline 5000, aft perpendicular 0, forward perpendicular 15000, midship 7500.
  2. [L2] Transverse frames with frame 0 at x = 0: frames 1 to 10 spaced 700, frames 11 to 20 spaced 800, and three frames aft of frame 0 spaced 600.
  3. [L3] Longitudinal Y frames: four each side of the centreline spaced 750. Longitudinal Z frames: four spaced 1000.
  4. [L4] Decks DK_A at z = 3000 (up), DK_B at z = 6000 (down), DK_C at z = 9000 (neutral). A transverse bulkhead plane BH1 at frame 5 plus 250, and a longitudinal bulkhead plane LBH1 at Y frame 2 plus 250.
  5. [L5] A deck plate system on DK_A bounded by FR0, FR10 and the second Y frame each side of the centreline, thickness 12.
  6. [L6] A transverse bulkhead plate system on BH1 bounded by the second Y frame each side, the bottom of the envelope and DK_B, thickness 8. A longitudinal bulkhead plate system on LBH1 bounded by FR0, FR10, the bottom of the envelope and DK_A, thickness 9.
  7. [L7] A block with its corner at (-1000, -3000, 0) measuring 9000 x 6000 x 5000. Then a hull plate system from the bottom face and the two side faces of that block, bounded by FR0 and FR10, thickness 15.
  8. [L8] A seam that splits the deck plate at FR4. A seam that splits the transverse bulkhead plate at z = 1500 and z = 4500.
  9. [stiffeners] A stiffener system on the deck plate along each Y frame. If this cannot be done on this machine, do not approximate it: report could-not with the reason.

Hull form

  1. [L9] A Wigley parabolic hull as ONE solid body, length 100000, beam 10000, draft 6250, with x = 0 at the aft end, the keel at z = 0 and the top closed by a flat face at the design waterline z = 6250. Half breadth y = (B/2) (1 - ((2x - L)/L)^2) (1 - ((T - z)/T)^2).

Ranking

Skills rank by total score. Ties go to the skill with more referee checks passed, then to the earlier upload. One row per author and skill shows the best upload. A skill without a live result is ranked on its static score and labelled.

Submit a skillSee the leaderboard