Benchmark catalog · 26 released tasks

Tasks

Explore functional-requirement design problems and reference-grounded implementation challenges. Published entries open the complete run evidence; empty entries establish the released catalog without inventing results.

Task catalog
26 shown
01Published result
Design / Discovery

WDM-v1

Four-Channel Electrothermal Dual-Ring WDM Channelizer

Design a four-channel dual-ring WDM channelizer near 1310 nm with eight independently contacted heaters and trusted electrothermal scoring.

Reporting score S0.1918–1.0039
02Published result
Design / Discovery

WDM-v2

Eight-Channel Electrothermal Dual-Ring WDM Channelizer

Design an eight-channel dual-ring WDM channelizer near 1310 nm with 16 independently heated rings and trusted electrothermal scoring.

Reporting score S0.1313–1.3655
03Published result
Design / Discovery

Microresonator-v1

Single-Ring O-Band Microresonator Modulator

Design a single-ring O-band microresonator modulator for 100 Gb/s operation with coupled optical, RF, electrical, and thermal verification.

Reporting score S1.2495–1.5597
04Published result
Design / Discovery

Microresonator-v2

Five-Channel C-Band WDM-PAM4 Microresonator Modulator

Design a five-channel C-band WDM-PAM4 microresonator modulator array with two-segment junctions, independent heaters, and trusted optical, RF, electrical, and thermal verification.

Reporting score S1.0603
05Published result
Design / Discovery

MZI-v1

Broadband 4x4 Rectangular MZI Mesh

Design a broadband 4×4 rectangular MZI mesh with independently controlled interferometers and trusted optical, electrical, and thermal verification.

Reporting score S0.6513–1.3426
06Published result
Design / Discovery

MZI-v2

Broadband 6x6 Rectangular MZI Mesh

Design a broadband 6×6 rectangular MZI mesh with 36 quantized controls and trusted optical, electrical, and electrothermal verification.

Reporting score S0.7345
07Published result
Design / Discovery

MZI-Ring-v1

MZI-Coupled Microring Add-Drop Filter Electrothermal Design

Design a compact four-port MZI-coupled microring add-drop filter with independent theta and phi heaters, trusted electrothermal tuning, and evaluator-owned optical scoring.

Reporting score S0.5406–0.7547
08Published result
Design / Discovery

MZI-Ring-v2

MZI-coupled microring add-drop filter electrothermal design v2

Design a fifth-order four-port Vernier microring add-drop filter with two physical bus MZIs, seven heaters, two fixed VOAs, and trusted local electrothermal and optical scoring.

Reporting score S0.0206
09Published result
Design / Discovery

Quantum-4

Four-Mode Quantum Projector Electrothermal Design

Design a four-mode quantum projector with a 4×4 interferometer network, electrothermal phase control, and trusted fidelity scoring.

Reporting score S0.4285–0.9861
10Published result
Design / Discovery

Quantum-8

Eight-Mode Quantum Projector Electrothermal Design

Design an eight-mode quantum projector with a tree of seven MZIs, 15 electrothermal phase controls, and trusted fidelity scoring.

Reporting score S0.2444
11Published result
Design / Discovery

MZI-Spec-8

Compact PDK-Physical Eight-Delay Sparse-Spectrum MZI Spectrometer

Design a compact eight-delay MZI spectrometer with physical SiEPIC couplers, a routed 1x8 splitter tree, 16 grating outputs, and trusted sparse-spectrum reconstruction scoring.

Reporting score S0.6776
12Published result
Design / Discovery

RAFT-Spec

Microring-Assisted Fourier Spectrometer Electrothermal Design

Design a microring-assisted Fourier spectrometer with a smooth add-drop resonator, thermally scanned MZI, physical heater routing, and trusted robust sparse-spectrum reconstruction scoring.

Reporting score S0.8436
13Published result
Design / Discovery

Ring-XC-v1

Four-Wavelength Two-Port Ring Selective Cross-Connect

Design a four-wavelength, two-input, two-output ring-selective cross-connect with independently compiled wavelength routes and trusted optical, electrical, thermal, DRC, and LVS verification.

Reporting score SN/E
14Published result
Design / Discovery

Ring-XC-v2

Four-Wavelength Four-Port Ring Selective Cross-Connect

Design a four-wavelength, four-input, four-output blocking-aware ring-selective cross-connect with independently compiled wavelength routes and trusted optical, electrical, thermal, DRC, and LVS verification.

Reporting score SN/E
15Published result
Design / Discovery

Serial MZI-v1

Serial Dual-Ring-Assisted MZI Elliptic Bandpass Electrothermal Design v1

Design a serial dual-ring-assisted MZI elliptic bandpass filter with five tunable couplers, three electrothermal phase controls, and trusted optical, electrical, thermal, DRC, and circuit verification.

Reporting score SN/E
16Published result
Design / Discovery

90SiN Bend-v0

90 Degree SiN Waveguide Bend Design

Design a low-loss 90-degree silicon-nitride waveguide bend at 1550 nm with a fixed Tidy3D setup, trusted cloud evaluation, and geometry DRC.

Reporting score S1.2724
17Published result
Implementation / Optimization

Anisotropic SWG-v0

Anisotropic SWG 2 x 2 Beamsplitter Implementation/Optimization

Implement and optimize an anisotropic subwavelength-grating 2 × 2 MMI beamsplitter over 1250–1750 nm. One input is simulated; strict y-mirror symmetry establishes the second input response.

Reporting score S1.2775
18Published result
Implementation / Optimization

α-Si/Si₃N₄ Grating-v0

α-Si/Si3N4 SWG Grating Coupler Implementation/Optimization

Implement and optimize the apodized α-Si/Si₃N₄ SWG grating at 1310 nm. Trusted FDTD measures coupling loss and both bandwidths against the paper-derived reference envelope.

Reporting score S0.4329
19Published result
Implementation / Optimization

Dual-Trident SWG-v0

Dual-Trident SWG Edge Coupler Implementation/Optimization

Implement and optimize a silicon dual-trident subwavelength-grating edge coupler over 1536–1628 nm. The trusted evaluator measures Gaussian-beam coupling into the output waveguide's fundamental TE mode.

Reporting score S0.2805
20Published result
Implementation / Optimization

HMDM polarization splitter–rotator

HMDM Polarization Splitter–Rotator Implementation/Optimization

Optimize the paper-derived polarization splitter–rotator's independently selectable nanohole sites. The trusted evaluator measures desired-mode transmission for TE₀ and TM₀ inputs across 1500–1600 nm.

Reporting score S0.1967
21Published result
Implementation / Optimization

HMDM six-channel WDM

HMDM Six-Channel WDM Binary Optimization

Optimize a six-channel WDM nanohole mask with independently selectable sites across the paper-derived design region. The trusted evaluator measures worst-channel insertion loss and crosstalk against the paper envelope.

Reporting score S0.1259
22Published result
Implementation / Optimization

Sb₂Se₃/Si Rotator-v0

Sb2Se3/Si Reconfigurable Polarization Rotator Implementation/Optimization

Implement and optimize a reconfigurable Sb₂Se₃/Si polarization rotator. The trusted evaluator scores worst-case polarization-conversion loss over both material states and 1290–1330 nm.

Reporting score S0.9905
23Published result
Implementation / Optimization

SRSN Grating-v0

SRSN Grating Coupler Implementation/Optimization

Implement and optimize a silicon-rich silicon nitride grating above a thin SiN waveguide for vertical fiber-to-chip coupling at 1550 nm. Compare evaluator-owned coupling loss with the paper’s 3D-FDTD baseline.

Reporting score S1.0468
24Published result
Implementation / Optimization

TFLN Crossing-v0

Three-Direction TFLN MMI Crossing Implementation/Optimization

Implement and optimize symmetric and asymmetric thin-film lithium-niobate MMI crossings at 1550 nm. Three independent crystal-direction subruns measure worst-direction insertion loss and enforce crosstalk and field-decay gates.

Reporting score S0.4019
25Published result
Implementation / Optimization

TFLN PI-MMI-v0

Polarization-Insensitive TFLN 1x2 MMI Implementation/Optimization

Implement and optimize a polarization-insensitive TFLN 1 × 2 MMI. The trusted evaluator measures worst-output excess loss for TE and TM across 1520–1580 nm.

Reporting score S0.6099
26Published result
Implementation / Optimization

Trapezoidal SWG-v0

Trapezoidal SWG 2 x 2 3-dB Coupler Implementation/Optimization

Implement and optimize a trapezoidal subwavelength-grating 2 × 2 coupler. Compare both physical input responses over 1400–1700 nm against the paper’s splitting and excess-loss envelope.

Reporting score S0.5281