{"data":{"status":"PARTIAL","confidence":0.26,"summary":"PARTIAL: 12 hyperparameter(s) pinned to verbatim quotes; no implementation was produced (constants header only); confidence 0.26.","nextStep":"Retry the request: model_analysis, code_generation did not finish within the time budget; treat this output as incomplete until it does.","partial":true,"missing":[{"stage":"model_analysis","impact":"the model analysis did not finish within the time budget; hyperparameters come from the deterministic extractor only and the summary is the abstract"},{"stage":"code_generation","impact":"the model-written implementation did not finish within the time budget; productionCode holds only the verified constants header"}],"timeBudget":{"budgetMs":80000,"elapsedMs":72000},"paper":{"arxivId":"1706.03762","title":"Attention Is All You Need","url":"http://arxiv.org/abs/1706.03762v7","publicationDate":"2017-06-12","textSource":"ar5iv"},"targetLanguage":"python","evidence":{"tokens":5798,"budgetTokens":18000,"truncated":false,"blocks":[{"id":"abstract","kind":"abstract","tier":"abstract","label":"Attention Is All You Need"},{"id":"S3.EGx1","kind":"equation","tier":"method","label":"display equation in section S3"},{"id":"S3","kind":"section","tier":"method","label":"3 Model Architecture"},{"id":"S3.SS1","kind":"section","tier":"method","label":"3.1 Encoder and Decoder Stacks"},{"id":"S3.EGx2","kind":"equation","tier":"method","label":"display equation in section S3"},{"id":"S3.SS2","kind":"section","tier":"method","label":"3.2 Attention"},{"id":"S3.SS2.SSS1","kind":"section","tier":"method","label":"3.2.1 Scaled Dot-Product Attention"},{"id":"S3.SS2.SSS2","kind":"section","tier":"method","label":"3.2.2 Multi-Head Attention"},{"id":"S3.SS2.SSS3","kind":"section","tier":"method","label":"3.2.3 Applications of Attention in our Model"},{"id":"S3.SS3","kind":"section","tier":"method","label":"3.3 Position-wise Feed-Forward Networks"},{"id":"S3.SS4","kind":"section","tier":"method","label":"3.4 Embeddings and Softmax"},{"id":"S3.SS5","kind":"section","tier":"method","label":"3.5 Positional Encoding"},{"id":"S4","kind":"section","tier":"method","label":"4 Why Self-Attention"},{"id":"S6.T3","kind":"table","tier":"hyperparameters","label":"Table 3: Variations on the Transformer architecture. Unlisted values are identical to those of the base model. All metri"},{"id":"S5","kind":"section","tier":"hyperparameters","label":"5 Training"},{"id":"S5.SS1","kind":"section","tier":"hyperparameters","label":"5.1 Training Data and Batching"},{"id":"S5.SS2","kind":"section","tier":"hyperparameters","label":"5.2 Hardware and Schedule"},{"id":"S5.SS3","kind":"section","tier":"hyperparameters","label":"5.3 Optimizer"},{"id":"S5.SS4","kind":"section","tier":"hyperparameters","label":"5.4 Regularization"},{"id":"S6.SS1","kind":"section","tier":"hyperparameters","label":"6.1 Machine Translation"},{"id":"S6.SS3","kind":"section","tier":"hyperparameters","label":"6.3 English Constituency Parsing"},{"id":"S6.SS2","kind":"section","tier":"ablation","label":"6.2 Model Variations"}],"omitted":[]},"coreAlgorithmSummary":"Model analysis unavailable (time budget). Abstract: The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 28.4 BLEU on the WMT 2014 English-to-German translation task, improving over the existing best results, including ensembles by over 2 BLEU. On the WMT 2014 English-to-French translation task, our model establishes a new single-model state-of-the-art BLEU score of 41.8 after training for 3.5 days on eight GPUs, a small fraction of the training costs of the best models from the literature. We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data.","extractedHyperparameters":[{"name":"N (base)","codeIdentifier":"N_BASE","value":"6","numericValue":6,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"d_{model} (base)","codeIdentifier":"D_MODEL_BASE","value":"512","numericValue":512,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"d_{ff} (base)","codeIdentifier":"D_FF_BASE","value":"2048","numericValue":2048,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"h (base)","codeIdentifier":"H_BASE","value":"8","numericValue":8,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"d_{k} (base)","codeIdentifier":"D_K_BASE","value":"64","numericValue":64,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"d_{v} (base)","codeIdentifier":"D_V_BASE","value":"64","numericValue":64,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"P_{drop} (base)","codeIdentifier":"P_DROP_BASE","value":"0.1","numericValue":0.1,"unit":"","source":{"kind":"table","id":"S6.T3","row":3},"quote":"base | 6 | 512 | 2048 | 8 | 64 | 64 | 0.1 | 0.1 | 100K | 4.92 | 25.8 | 65","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"warmup steps","codeIdentifier":"WARMUP_STEPS","value":"4000","numericValue":4000,"unit":"","source":{"kind":"section","id":"S5.SS3","row":0},"quote":"warmup\\_steps=4000","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"beta 1","codeIdentifier":"BETA_1","value":"0.9","numericValue":0.9,"unit":"","source":{"kind":"section","id":"S5.SS3","row":0},"quote":"\\beta_{1}=0.9","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"beta 2","codeIdentifier":"BETA_2","value":"0.98","numericValue":0.98,"unit":"","source":{"kind":"section","id":"S5.SS3","row":0},"quote":"\\beta_{2}=0.98","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"epsilon","codeIdentifier":"EPSILON","value":"10^{-9}","numericValue":1e-9,"unit":"","source":{"kind":"section","id":"S5.SS3","row":0},"quote":"\\epsilon=10^{-9}","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"},{"name":"epsilon ls","codeIdentifier":"EPSILON_LS","value":"0.1","numericValue":0.1,"unit":"","source":{"kind":"section","id":"S5.SS4","row":0},"quote":"\\epsilon_{ls}=0.1","agreement":{"samples":1,"of":1},"verifier":"deterministic_agreement"}],"droppedHyperparameters":[],"ablationWarnings":[],"productionCode":"# Hyperparameters generated from the verified paper values; do not edit.\nN_BASE = 6  # N (base) [table S6.T3 row 3]\nD_MODEL_BASE = 512  # d_{model} (base) [table S6.T3 row 3]\nD_FF_BASE = 2048  # d_{ff} (base) [table S6.T3 row 3]\nH_BASE = 8  # h (base) [table S6.T3 row 3]\nD_K_BASE = 64  # d_{k} (base) [table S6.T3 row 3]\nD_V_BASE = 64  # d_{v} (base) [table S6.T3 row 3]\nP_DROP_BASE = 0.1  # P_{drop} (base) [table S6.T3 row 3]\nWARMUP_STEPS = 4000  # warmup steps [section S5.SS3]\nBETA_1 = 0.9  # beta 1 [section S5.SS3]\nBETA_2 = 0.98  # beta 2 [section S5.SS3]\nEPSILON = 1e-9  # epsilon [section S5.SS3]\nEPSILON_LS = 0.1  # epsilon ls [section S5.SS4]","codeCheck":{"language":"python","status":"unchecked","repaired":false,"checker":"not run","diagnostics":["no model-written code was produced"],"executed":false},"literalCheck":{"status":"unchecked","mismatches":[],"notCited":[],"unattributed":[],"patched":0},"provenance":{"hyperparameters":{"modelSamples":0,"deterministicExtractor":true,"extractorFound":12,"confirmedByExtractor":12,"verifiedByModel":0},"constantsHeader":"deterministic","literalPatches":0,"redeclarationsDropped":0,"llmCalls":{"analysis":1,"verifier":0,"codegen":1,"total":2}},"warnings":["model analysis timed out: hyperparameters come from the deterministic extractor alone, so recall is lower and no model cross-check ran","8 further extractor-only hyperparameter(s) omitted; the paper states many settings","code generation did not finish in time: productionCode is the verified constants header only","generated code was not executed; review it before running"],"whatWouldChange":["A retry with a free time budget, which adds model-extracted hyperparameters and an algorithm summary","A retry with a free time budget, which generates the implementation"]},"_provenance":{"version":"writerslogic-provenance/1","issuer":"did:web:agents.writerslogic.com","verify":{"endpoint":"POST /api/v1/verify-provenance","did":"did:web:agents.writerslogic.com"},"manifest":{"format":"application/json","instance_id":"xmp:iid:6b741bcb-6dd4-44ce-9793-6b05f1073c2f","claim_generator_info":[{"name":"WritersLogic x402 Agent Hub","version":"2.0.0"}],"title":"arXiv-to-Production Code & Hyperparameter Compiler","assertions":[{"label":"c2pa.actions.v2","data":{"actions":[{"action":"c2pa.created","when":"2026-11-06T17:56:29.516Z","softwareAgent":{"name":"writerslogic-agent-hub/arxiv-to-code","version":"2.0.0"},"digitalSourceType":"http://cv.iptc.org/newscodes/digitalsourcetype/trainedAlgorithmicMedia","parameters":{"endpoint":"POST /api/v1/arxiv-to-code","inputDigest":{"alg":"sha256","hash":"3949e9ced3ea7c20da9fec83bb3664a11a07db908d893e1bf2d3804a63c27798","canonicalization":"JCS"}}}]}},{"label":"c2pa.hash.data","data":{"alg":"sha256","hash":"8d9da436e97fea95d8de1a4e5b9e3272900d9ee250112fd5cce9edd2f1634aa6","name":"jcs-canonical-json(data)"}},{"label":"c2pa.ingredient.v3","data":{"title":"https://ar5iv.labs.arxiv.org/html/1706.03762","format":"text/html","relationship":"inputTo","dc":{"source":"https://ar5iv.labs.arxiv.org/html/1706.03762","date":"2026-11-06T17:55:18.224Z"},"hash":{"alg":"sha256","hash":"0be131a31e2cc29bdbf4723c5c9971d2ae9d102794e3c34252e6aec445744cda","basis":"body"}}},{"label":"c2pa.ingredient.v3","data":{"title":"https://export.arxiv.org/api/query?start=0&max_results=10&id_list=1706.03762","format":"application/atom+xml","relationship":"inputTo","dc":{"source":"https://export.arxiv.org/api/query?start=0&max_results=10&id_list=1706.03762","date":"2026-11-06T17:55:18.254Z"},"hash":{"alg":"sha256","hash":"5413aaf35bcf9b66a432c70e0a3d0d24ec01ca4c6197321a470d6d2d98a7aab4","basis":"body"}}}]},"credential":{"@context":["https://www.w3.org/ns/credentials/v2"],"id":"urn:uuid:38b26b85-5686-4361-8323-24f7f1d04542","type":["VerifiableCredential","AgentOutputCredential"],"issuer":"did:web:agents.writerslogic.com","validFrom":"2026-11-06T17:56:29.516Z","credentialSubject":{"id":"urn:sha256:8d9da436e97fea95d8de1a4e5b9e3272900d9ee250112fd5cce9edd2f1634aa6","agent":"arxiv-to-code","endpoint":"POST /api/v1/arxiv-to-code","outputDigest":{"alg":"sha256","value":"8d9da436e97fea95d8de1a4e5b9e3272900d9ee250112fd5cce9edd2f1634aa6","canonicalization":"JCS"},"inputDigest":{"alg":"sha256","value":"3949e9ced3ea7c20da9fec83bb3664a11a07db908d893e1bf2d3804a63c27798","canonicalization":"JCS"},"manifestDigest":{"alg":"sha256","value":"1a170f176735f3aea24f018d0705b29a595f6d951d5177030dd8ef3669fe973f","canonicalization":"JCS"},"ingredients":[{"url":"https://ar5iv.labs.arxiv.org/html/1706.03762","sha256":"0be131a31e2cc29bdbf4723c5c9971d2ae9d102794e3c34252e6aec445744cda"},{"url":"https://export.arxiv.org/api/query?start=0&max_results=10&id_list=1706.03762","sha256":"5413aaf35bcf9b66a432c70e0a3d0d24ec01ca4c6197321a470d6d2d98a7aab4"}],"payment":{"scheme":"api-key","network":"eip155:8453","payer":"sample"}},"proof":{"type":"DataIntegrityProof","cryptosuite":"eddsa-jcs-2022","created":"2026-11-06T17:56:29.516Z","verificationMethod":"did:web:agents.writerslogic.com#key-1","proofPurpose":"assertionMethod","proofValue":"z4rvkrNJ8fuXAyo4obVuKHe1PekYRAQfcyssr79Je1GF3C9RdJ1icUehDea6rsAKeg7tPhsP27dtzzfTMumnjfwtk"}},"ethSignature":{"type":"EIP-191","signer":"did:pkh:eip155:8453:0x3DBd42560cA7a7E448A2c7DfC9E785526189411f","address":"0x3DBd42560cA7a7E448A2c7DfC9E785526189411f","message":"writerslogic-provenance:568c20275c89f236585e3da2eca2b253323b361a87695dc60bf1b6070a442d46","signature":"0xf50f8376eb145de27d0988f9e5cc93947d71a7038b37e619dcb917846b3c08e974cc9d1945f08eef9d5ec8293f002b3bb48dea0c966fa1dfa1e772ccea58f6141c"}}}