# Excalidraw Data ## Text Elements SPMD sharding across two TPU notebooks ^elem0001 1001 megaminx puzzles ^elem0003 v19a (TPU): pids 0–499 · K=4 · B=1M ^elem0005 v19b (TPU): pids 500–1000 · K=4 · B=1M ^elem0007 min-merge ^elem0009 submission CSV ^elem0011 Both notebooks load the same m05 + sym-ensemble; SPMD lets B=1M fit by sharding the puzzle list ^elem0017 %% ## Drawing ```json { "type": "excalidraw", "version": 2, "source": "https://github.com/zsviczian/obsidian-excalidraw-plugin", "elements": [ { "id": "elem0001", "type": "text", "x": 330, "y": 25, "width": 459, "height": 27, "strokeColor": "#1e1e1e", "fontSize": 22, "fontFamily": 5, "text": "SPMD sharding across two TPU notebooks", "textAlign": "center", "verticalAlign": "top", "containerId": null, "originalText": "SPMD sharding across two TPU notebooks", "lineHeight": 1.25, "baseline": 19, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000001, "version": 1, "versionNonce": 2000001, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0002", "type": "rectangle", "x": 80, "y": 230, "width": 200, "height": 70, "strokeColor": "#1971c2", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000002, "version": 1, "versionNonce": 2000002, "isDeleted": false, "boundElements": [ { "type": "text", "id": "elem0003" } ], "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "#e7f5ff" }, { "id": "elem0003", "type": "text", "x": 87.6, "y": 257.0, "width": 184, "height": 20, "strokeColor": "#1e1e1e", "fontSize": 16, "fontFamily": 5, "text": "1001 megaminx puzzles", "textAlign": "center", "verticalAlign": "middle", "containerId": "elem0002", "originalText": "1001 megaminx puzzles", "lineHeight": 1.25, "baseline": 14, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000003, "version": 1, "versionNonce": 2000003, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0004", "type": "rectangle", "x": 350, "y": 130, "width": 320, "height": 90, "strokeColor": "#7048e8", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000004, "version": 1, "versionNonce": 2000004, "isDeleted": false, "boundElements": [ { "type": "text", "id": "elem0005" } ], "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "#d0bfff" }, { "id": "elem0005", "type": "text", "x": 365.625, "y": 167.5, "width": 288, "height": 18, "strokeColor": "#1e1e1e", "fontSize": 15, "fontFamily": 5, "text": "v19a (TPU): pids 0\u2013499 \u00b7 K=4 \u00b7 B=1M", "textAlign": "center", "verticalAlign": "middle", "containerId": "elem0004", "originalText": "v19a (TPU): pids 0\u2013499 \u00b7 K=4 \u00b7 B=1M", "lineHeight": 1.25, "baseline": 13, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000005, "version": 1, "versionNonce": 2000005, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0006", "type": "rectangle", "x": 350, "y": 320, "width": 320, "height": 90, "strokeColor": "#7048e8", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000006, "version": 1, "versionNonce": 2000006, "isDeleted": false, "boundElements": [ { "type": "text", "id": "elem0007" } ], "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "#d0bfff" }, { "id": "elem0007", "type": "text", "x": 353.25, "y": 357.5, "width": 313, "height": 18, "strokeColor": "#1e1e1e", "fontSize": 15, "fontFamily": 5, "text": "v19b (TPU): pids 500\u20131000 \u00b7 K=4 \u00b7 B=1M", "textAlign": "center", "verticalAlign": "middle", "containerId": "elem0006", "originalText": "v19b (TPU): pids 500\u20131000 \u00b7 K=4 \u00b7 B=1M", "lineHeight": 1.25, "baseline": 13, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000007, "version": 1, "versionNonce": 2000007, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0008", "type": "rectangle", "x": 730, "y": 220, "width": 170, "height": 100, "strokeColor": "#c92a2a", "angle": 0, "strokeWidth": 3, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000008, "version": 1, "versionNonce": 2000008, "isDeleted": false, "boundElements": [ { "type": "text", "id": "elem0009" } ], "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "#ffa8a8" }, { "id": "elem0009", "type": "text", "x": 770.45, "y": 261.0, "width": 89, "height": 22, "strokeColor": "#1e1e1e", "fontSize": 18, "fontFamily": 5, "text": "min-merge", "textAlign": "center", "verticalAlign": "middle", "containerId": "elem0008", "originalText": "min-merge", "lineHeight": 1.25, "baseline": 16, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000009, "version": 1, "versionNonce": 2000009, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0010", "type": "rectangle", "x": 950, "y": 240, "width": 180, "height": 60, "strokeColor": "#2f9e44", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000010, "version": 1, "versionNonce": 2000010, "isDeleted": false, "boundElements": [ { "type": "text", "id": "elem0011" } ], "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "#b2f2bb" }, { "id": "elem0011", "type": "text", "x": 982.25, "y": 262.5, "width": 115, "height": 18, "strokeColor": "#1e1e1e", "fontSize": 15, "fontFamily": 5, "text": "submission CSV", "textAlign": "center", "verticalAlign": "middle", "containerId": "elem0010", "originalText": "submission CSV", "lineHeight": 1.25, "baseline": 13, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000011, "version": 1, "versionNonce": 2000011, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0012", "type": "arrow", "x": 280, "y": 175.0, "width": 70, "height": 90.0, "strokeColor": "#1e1e1e", "points": [ [ 0, 90.0 ], [ 35, 90.0 ], [ 35, 0.0 ], [ 70, 0.0 ] ], "lastCommittedPoint": null, "startBinding": null, "endBinding": null, "startArrowhead": null, "endArrowhead": "arrow", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000012, "version": 1, "versionNonce": 2000012, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent", "elbowed": true }, { "id": "elem0013", "type": "arrow", "x": 280, "y": 265.0, "width": 70, "height": 100.0, "strokeColor": "#1e1e1e", "points": [ [ 0, 0.0 ], [ 35, 0.0 ], [ 35, 100.0 ], [ 70, 100.0 ] ], "lastCommittedPoint": null, "startBinding": null, "endBinding": null, "startArrowhead": null, "endArrowhead": "arrow", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000013, "version": 1, "versionNonce": 2000013, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent", "elbowed": true }, { "id": "elem0014", "type": "arrow", "x": 670, "y": 175.0, "width": 60, "height": 95.0, "strokeColor": "#1e1e1e", "points": [ [ 0, 0.0 ], [ 30, 0.0 ], [ 30, 95.0 ], [ 60, 95.0 ] ], "lastCommittedPoint": null, "startBinding": null, "endBinding": null, "startArrowhead": null, "endArrowhead": "arrow", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000014, "version": 1, "versionNonce": 2000014, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent", "elbowed": true }, { "id": "elem0015", "type": "arrow", "x": 670, "y": 270.0, "width": 60, "height": 95.0, "strokeColor": "#1e1e1e", "points": [ [ 0, 95.0 ], [ 30, 95.0 ], [ 30, 0.0 ], [ 60, 0.0 ] ], "lastCommittedPoint": null, "startBinding": null, "endBinding": null, "startArrowhead": null, "endArrowhead": "arrow", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000015, "version": 1, "versionNonce": 2000015, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent", "elbowed": true }, { "id": "elem0016", "type": "arrow", "x": 900, "y": 270.0, "width": 50, "height": 1, "strokeColor": "#1e1e1e", "points": [ [ 0, 0.0 ], [ 50, 0.0 ] ], "lastCommittedPoint": null, "startBinding": null, "endBinding": null, "startArrowhead": null, "endArrowhead": "arrow", "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000016, "version": 1, "versionNonce": 2000016, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" }, { "id": "elem0017", "type": "text", "x": 150, "y": 460, "width": 731, "height": 17, "strokeColor": "#555555", "fontSize": 14, "fontFamily": 5, "text": "Both notebooks load the same m05 + sym-ensemble; SPMD lets B=1M fit by sharding the puzzle list", "textAlign": "center", "verticalAlign": "top", "containerId": null, "originalText": "Both notebooks load the same m05 + sym-ensemble; SPMD lets B=1M fit by sharding the puzzle list", "lineHeight": 1.25, "baseline": 12, "angle": 0, "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 1000017, "version": 1, "versionNonce": 2000017, "isDeleted": false, "boundElements": null, "updated": 1714838400000, "link": null, "locked": false, "fillStyle": "solid", "backgroundColor": "transparent" } ], "appState": { "viewBackgroundColor": "#ffffff", "currentItemFontFamily": 5, "gridSize": null }, "files": {} } ``` %%