Swaroop Kumar Pal

A self-evolving education and research platform to make expert-level learning and building accessible to everyone. Every morning it writes The Daily Delve — a narrated, personalized research brief — and grows a library of interactive lessons, paths and maps through agentic pipelines. Product design, agentic architecture and novel learning interfaces, all built nights and weekends.

Point at an object and the robot picks it: diffusion policies for target-specific manipulation, conditioned on a pointed target. Built the MuJoCo simulation and Modal evaluation infrastructure spanning sim and a real UR arm with a fisheye gripper camera. Honorable mention among ~250 Stanford CS224R projects.

Hold a key, speak, and the bedroom wall answers. A local pipeline: on-device Whisper turns speech to text in ~0.1 s, a Haiku router reads the intent, and Claude specialists — ambient art, todos, info, cameras, system — run their tools and post scenes to a FastAPI WebSocket server, which a chromeless Chrome paints onto the projector. About a thousand lines end to end, offline except the model calls, with the same wall tools exposed to Claude Desktop over MCP.

What I'm saying in the demo

LOOM — listen, remix and own the world's living musical traditions. At its heart is Atlas, the infinite synthesizer: tap a vibe world — lo-fi, Afrobeat, Indian raga, gamelan — and a wheel of notes starts spinning; open the rack for euclidean drums and synth panels; record a take and publish it to the gallery. Behind it, Magenta RealTime 2 runs live on Apple Silicon — music generated at 25 Hz, streamed as 48 kHz PCM over a WebSocket into a gapless AudioWorklet — and a Perform mode conducts it with MediaPipe hand tracking: morph styles by moving your hand, raise it for drums and energy.

A visual navigation pipeline that turns monocular or RGB-D video into semantically labeled 2D and 3D maps — neural SLAM, a fine-tuned detector, SAM segmentation and geometric projection, evaluated on Replica (Stanford CS231n). GAS v2 rebuilds the pipeline with modern foundation models through agentic engineering: what can 30 minutes and 30 cents of compute do to a research paper?

A tangible companion robot with mixed-reality, voice and touch interfaces, built in a weekend at MIT Media Lab's Reality, Virtually hackathon. 1st prize in the Getting Things Done and Doing Business category.

A mixed-reality smart home: a HoloLens app giving a spatial, gaze-and-gesture UI to cross-platform IoT devices — an Android music player and an Arduino-driven fan and light — over TCP. Built at Microsoft's SF Holohacks hackathon and featured in Digital Trends; later re-imagined on Magic Leap.

A hybrid LLM + POMDP wellness agent that treats hidden well-being — body, mind, soul — as unobservable state, inferring beliefs from chat and choosing supportive actions with online forward search. Lives on as Eanors, a decision playground on the web.

A two-player augmented-reality treasure hunt built on Google's Project Tango with the Tango Unity SDK: one player hides virtual treasures around a real indoor space, the other follows clues and a trail to find them.

A virtual pawn shop built in Unity 5 for Oculus Rift DK1, where users navigate and pick out glowing objects with Wii remotes — the environment behind the IEEE 3DUI head-tracking user study.

A VR simulation of the da Vinci Xi surgical robot with interactive arm manipulation — Unity, Maya and motion capture, experienced on Oculus Rift DK1.

The pawn shop scene modeled in Maya, rebuilt as a Google Cardboard VR app in Unity — an expert-built environment in anyone's pocket.

An Android app integrating Unity and OpenCV: camera frames feed Lucas-Kanade optical flow so real-world steps become virtual motion, tested on Samsung Gear VR.

Dynamic projection mapping on real objects using a Kinect, with basic interactivity — an early experiment at the intersection of art and science.

A model smart home where appliances and doors respond to face recognition — OpenCV vision with Arduino and AVR microcontrollers driving relays, motors and door locks over LAN.

A motion-controlled Android game steered by accelerometer readings, drawn with SurfaceView and custom views.

A bedroom wall that listens — speak, and it paints ambient art, answers questions, or streams a camera. The full build lives in Claude Mambo under Things I've Made.

The Point-and-Pick rig at home: live detections, wrist-camera view, and a yellow arm sorting blocks off the desk.

A generative rain of glyphs projected across the living-room wall.

A wingback chair dressed in projected stripes and patterns — furniture as canvas.

An acoustic guitar lit with spirals and stripes of light.

An LLM choreographs a LeRobot arm — traveling waves through shoulder, elbow and wrist.

Dot-matrix mandalas and test patterns on the studio wall.

An installation wall where every frame animates under projection.

A LEGO diorama brought to weather and bloom by projection.

A googly-eyed cardboard robot that lives on the desk.

Claude solves the math, then an AxiDraw draws the working — tool use over MCP, ink on paper.

Servos, speakers and an OLED face — a little machine with moods.