mugli

Train nanochat on 2 NVIDIA DGX Sparks

Last updated and tested: April 19, 2026

This guide is about training nanochat on 2 DGX Sparks linked via QSFP/CX7. I estimate the training to take about 5 days (about half the training time on 1 DGX Spark).

Prerequisites

Follow the following NVIDIA tutorials to link and test your Spark cluster:

mugli

Use macOS-style shortcuts in Windows / keyboard mappings using a Mac keyboard on Windows

Make Windows PC's shortcut act like macOS (Mac OS X) (using AutoHotkey (ahk) script)

With this AutoHotKey script, you can use most macOS style shortcuts (eg, cmd+c, cmd+v, ...) on Windows with a standard PC keyboard.

How does it work

Here's some examples of how this script work:

mugli

Go Learning Resources

1) For someone who is just beginning or have relatively short time:

• https://go.dev/tour/welcome/1 Tour of all important Go language features can be done online.
• https://go.dev/doc/effective_go Introduces a lot of Go idioms, patterns, conventions and philosophies.
• https://go.dev/doc/faq The official FAQ should answer all your questions.
• https://gobyexample.com/ Short and hands-on introduction to Go using annotated example programs.
• https://quii.gitbook.io/learn-go-with-tests/ Learn go with TDD.

2) When someone who knows some Go already:

mugli

Go modules

Tools

• Like go get but for Go tools: https://github.com/bwplotka/bingo
• https://github.com/sirkon/go-imports-rename
• https://github.com/KSubedi/gomove
• Visualize Go Dependency Trees: https://github.com/KyleBanks/depth
• Make temporary edits to your Go module dependencies: https://github.com/rogpeppe/gohack
• https://github.com/icholy/gomajor

mugli

/*
A data race happens when processes have to access the same variable concur 
rently i.e. one process reads from a memory location while another simultaneously 
writes to the exact same memory location.
*/

func main() {
    number := 0;
    
    go func(){

mugli

func main() {
    ch1 := make(chan int)
    ch2 := make(chan int)
    go func() {
        v := 1
        ch1 <- v
        v2 := <-ch2
        fmt.Println(v, v2)
    }()
    v := 2

mugli

// ==UserScript==
// @name         Termin Notifier
// @namespace    http://tampermonkey.net/
// @version      0.1
// @description  try to take over the world!
// @author       You
// @match        https://service.berlin.de/terminvereinbarung/*
// @icon         https://www.google.com/s2/favicons?domain=berlin.de
// @grant        none
// ==/UserScript==

mugli

package main

import (
	"encoding/json"
	"io/ioutil"
)

func readJSON(fileName string, filter func(map[string]interface{}) bool) []map[string]interface{} {
	datas := []map[string]interface{}{}

mugli

Go (Golang) concurrency patterns - collection of resources

Talks/slides:

1. Visualizing Concurrency in Go 🔥

• https://www.youtube.com/watch?v=KyuFeiG3Y60
• https://divan.dev/posts/go_concurrency_visualize/

2. Concurrency Patterns In Go - Arne Claus - Golang UK Conference 2017

• https://www.youtube.com/watch?v=YEKjSzIwAdA&feature=youtu.be

mugli

If you have two days to learn the very basics of modelling, Domain-Driven Design, CQRS and Event Sourcing, here's what you should do:

In the evenings read the [Domain-Driven Design Quickly Minibook]{http://www.infoq.com/minibooks/domain-driven-design-quickly}. During the day watch following great videos (in this order):

1. Eric Evans' [What I've learned about DDD since the book]{http://www.infoq.com/presentations/ddd-eric-evans}
2. Eric Evans' [Strategic Design - Responsibility Traps]{http://www.infoq.com/presentations/design-strategic-eric-evans}
3. Udi Dahan's [Avoid a Failed SOA: Business & Autonomous Components to the Rescue]{http://www.infoq.com/presentations/SOA-Business-Autonomous-Components}
4. Udi Dahan's [Command-Query Responsibility Segregation]{http://www.infoq.com/presentations/Command-Query-Responsibility-Segregation}
5. Greg Young's [Unshackle Your Domain]{http://www.infoq.com/presentations/greg-young-unshackle-qcon08}
6. Eric Evans' [Acknowledging CAP at the Root -- in the Domain Model]{ht