DEV Community

Isha Vishwakarma
Isha Vishwakarma

Posted on Fully Autonomous

What Does My Neighborhood Sound Like? I Built Hushmap to Find Out

Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass Submission 🌿

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

Most city maps show what a place looks like. Hushmap explores what it sounds like.

It’s a local-first prototype for people who want to notice the soundscape around them. On a walk, you can record a four-second clip or choose a short audio file. Hushmap runs the open YAMNet audio model in your browser and displays broad Birds, Traffic, Water, and People scores. You can save scores privately in your browser or export them.

The map and its suggested walks use clearly labeled illustrative sample data. Hushmap doesn’t yet map real community observations or provide actual routes. The idea is to make a walk an excuse to pause, listen, and notice the sounds around you.

Demo

Code

Hushmap

A soundscape atlas for your city. Hushmap lets you pause on a walk, listen to the place around you, and classify a short sound clip right in your browser. Recordings stay on your device; you decide whether to save or export the resulting scores.

Built for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass.

Demo

Watch the Hushmap demo on YouTube

The map presents an illustrative neighborhood soundscape. The demo also shows YAMNet classifying audio locally in the browser.

What Hushmap does

  • Explore an interactive neighborhood soundscape map and try quiet, birdsong, water, and city-sound searches.
  • Record a four-second clip or select an audio file up to 20 seconds for on-device classification.
  • See broad Birds, Traffic, Water, and People scores derived from YAMNet’s AudioSet labels.
  • Save scores to a private browser notebook or export them as JSON.
  • Optionally share derived scores and an audio embedding with a…

How I Built It

I built the interface as a small JavaScript app and used ONNX Runtime Web to run YAMNet in the browser. The model takes a short mono audio sample, produces AudioSet sound-class scores and embeddings, and Hushmap groups some labels into four broad categories.

The recording is processed in memory and discarded after classification. Scores stay in the browser unless the user saves or exports them. There is also an optional Tiger Data/pgvector integration path that requires a separate consent action and a configured database; I haven’t connected it to a live service.

Why Does Open Innovation Matter?

A neighborhood recording might contain a private conversation or a child’s voice. With a cloud-only classifier, the audio would have to leave the device to get sound labels. Using open model weights lets Hushmap run classification in the browser, so the raw recording can stay local.

Open weights and labels also let builders inspect the model’s vocabulary and adjust how sound labels are grouped. This is a prototype, though: the category scores aren’t calibrated environmental measurements, and the sample map isn’t collected community data.

My Agent Session

Hushmap: Full Project Conversation Before DevRelay
You

1. "Hushmap" — an open soundscape atlas of your city\
\
Everyone maps what places look like; nobody maps what they sound like. You walk, your phone records short clips, open audio models (YAMNet/BirdNET) classify them on-device — birdsong density, traffic roar, water, human noise — and only the scores get uploaded. The result: a community heatmap answering "where's the quietest 20-minute walk near me?" or "which park has the most birds at 7am?"\
\
- Genuinely new data product, not another LLM wrapper — judges reward that under technical execution and creativity\
- The "why open innovation matters" answer is airtight: audio of your neighborhood cannot go to a cloud API; on-device open models make the privacy model possible at all\
- Category stack: Gemma (natural-language "find me a quiet lunch walk" queries), Tiger Data (pgvector over audio embeddings — a $100 lane almost nobody will enter), TabPFN (predict a spot's quietest hour from the collected tabular readings — second near-empty lane), Render/DigitalOcean (host the map)\
- Write-up story: a week of walks building the map of your own neighborhood, with the map embedded make this for https://dev.to/devteam/join-the-hacktoberfest-open-source-ai-challenge-week-1-touch-grass-2450-in-prizes-across-17-4pom?bb=264620 this

Agent

I created two deliverables:

  • Interactive Hushmap prototype — an illustrated sample map with quiet and birds filters, spot details, walk suggestions, and a microphone-permission check. The microphone check does not record or upload audio.
  • DEV submission draft — follows the challenge template and distinguishes the working demo from proposed model and hosting integrations.

The map’s locations and scores are illustrative; on-device classification and real community data collection are not implemented yet. The challenge deadline was October 11 at 11:59 PM PDT, so the draft flags that the Week 1 submission window has passed. (challenge details)

You

implement this in my local and deadline is still left because its in PDT

Agent

You’re right—the deadline is still open. It’s 12:27 PM PDT on October 11, so there are about 11 hours 32 minutes until the 11:59 PM PDT cutoff. (Challenge details)

I implemented the local app with browser-based YAMNet classification, a four-second microphone capture, local audio-file classification, and a private score notebook with JSON export. Run it with npm install and npm run dev.

The audio stays in the browser; scores are saved locally only if you choose to save them. The map and route suggestions are still illustrative sample data, and Gemma, Tiger Data, TabPFN, and hosting integrations are not implemented. The development server starts, but I couldn’t verify a production build here: Vite hit a Windows sandbox EPERM while resolving the workspace file.

You

why no partner category

Agent

I left partner categories out because I focused on the working local app and didn’t want to claim integrations that weren’t implemented. But your brief explicitly included them, so I should have followed through before calling it done.

I’ve now added an opt-in Tiger Data/pgvector integration: it can store YAMNet embeddings and category scores, then search for similar sounds. Raw audio is never sent. The Tiger Data extension guide lists pgvector for AI-focused services.

The integration needs your Tiger Cloud DATABASE_URL, which wasn’t configured here, so I couldn’t connect it to a live service. The draft marks Best Use of Tiger Data as a potential entry until you can run a contribution and similarity search.

You

No Gemma, TabPFN, Render, or DigitalOcean category is claimed in this version; those integrations are not implemented.

why use these too

Agent

We shouldn’t add partner tools just to list more categories. Each one should support a real part of Hushmap:

  • Gemma could understand flexible requests like “a calm route with water and birds.” The current sample map has no real sound readings for it to search, so adding it now wouldn’t improve the result.
  • TabPFN could predict quieter hours, but that needs real observations across different times. The current map is illustrative.
  • Render can host the app. I added a Render Blueprint at render.yaml; it still needs deployment and a public-safety review.
  • Tiger Data has an opt-in integration path, but it still needs a live database connection and a working demo before its partner category can be claimed.

I updated the Dev.to draft to explain why Gemma and TabPFN aren’t in this prototype, and refreshed the local app ZIP.

The JavaScript syntax checks completed. The production build could not be verified: Vite hit a Windows EPERM error while resolving index.html.

You

now tell how to run it and record a demo video

Agent

Run Hushmap

  1. Open PowerShell in the project folder:
   cd "[local Hushmap project path]"
  1. Install dependencies and start the app:
   npm install
   npm run dev
  1. Open the Local URL Vite prints—usually http://[REDACTED]:5173. Keep that PowerShell window open while using the app. Microphone access works on localhost; allow it if the browser asks.

Record a short demo

Use Windows Snipping Tool screen recording (Win + Shift + R) or another screen recorder. A 45–60 second take could show:

  1. The map and its disclaimer: point out that pins and scores are illustrative sample data.
  2. A search: enter “quiet walk with birds” or click “Near water.” Explain that suggestions currently use a simple local keyword match and sample locations.
  3. On-device audio classification: click Record 4s, allow microphone access, and capture a short outdoor sound. Wait for the first-use YAMNet model to load; show the category scores and the “on-device” status.
  4. Private save: enter an optional place label, click Save on device, then show the notebook entry. The scores stay in that browser unless separately exported.
  5. Close with the limitation: say that real inference works, while the map itself still uses sample data.

For a cleaner recording, use headphones or record in a quiet place to avoid feedback. Don’t check the Tiger Data consent box in the demo unless you have configured a database and intend to send the derived scores and embedding.

I’d avoid claiming the map is community data or that the app finds actual quiet routes: those features aren’t implemented yet.

You

i see error cannot GET "/"

Agent

That error usually means you opened the API server at http://[REDACTED]:3001. The app’s page is served by Vite on http://[REDACTED]:5173.

Keep npm run dev running, then open the Local URL shown in the terminal—typically http://[REDACTED]:5173/. If Vite printed a different port, use that URL.

You

okay now what to do to record

Agent
  1. Open the app at http://[REDACTED]:5173/ and arrange the browser window so the map and “Contribute a listen” panel are visible.
  2. Press Win + Shift + R to open Windows Snipping Tool’s screen recorder. Select the app area and click Start.
  3. In Hushmap, click Record 4s and allow microphone access. Wait for the YAMNet scores to appear.
  4. Show the result, optionally save it on device, then point out that the map uses illustrative sample data.
  5. Stop recording from the Snipping Tool toolbar and save the video.

A simple narration: “Hushmap classifies a short sound in the browser using YAMNet. The recording stays on this device. These scores are one local listen; the map is still illustrative sample data.”

You

i get no available backend found error

Agent

That error means the browser couldn’t start ONNX Runtime’s local WASM model. Try this first:

  1. In the PowerShell window running Hushmap, press Ctrl + C, then restart it with npm run dev from the project folder.
  2. Open the Vite URL, usually http://[REDACTED]:5173/, and press Ctrl + Shift + R to reload.
  3. Check that the project has a public\ort folder. It contains the runtime files the model needs.

Then click Record 4s again. If it still fails, press F12, open Console, and send me the full error text—especially the part after ERR:. That will show which runtime file the browser couldn’t load.

You

still getting error you check for yourself

Agent

I reproduced the error and fixed it. Vite was rejecting ONNX Runtime’s attempt to dynamically import a WASM module from the app’s public folder.

I changed the runtime configuration and verified classification in the browser using a short test WAV; it returned YAMNet scores successfully. Your local dev server should have picked up the change. Reload http://[REDACTED]:5173/ and try Record 4s again. The refreshed app ZIP also includes the fix: hushmap-local-app.zip.

You

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

<!-- What does it do, and how does it get people off the screen and into the world? Who is it for? -->

Demo

<!-- Share a deployed link or a video demo. -->

Code

<!-- Show us the code! You can embed a GitHub repo directly into your post. -->

How I Built It

<!-- Which open-source AI did you use (open-weight models, agent harnesses, frameworks, local inference), and how is your project built around it? -->

Why Does Open Innovation Matter?

<!-- Why does open innovation matter for what you built? What did it make possible that a closed API wouldn't? -->

My Agent Session

<!-- Optional, but judges love it. Save your session with DevRelay and embed it with the agent_session tag (see the challenge page), or link to it. -->

Prize Categories

<!-- Which partner categories are you entering? List every one that applies, or remove this section. -->

<!-- Team Submissions: Please pick one member to publish the submission and credit teammates by listing their DEV usernames directly in the body of the post. -->

<!-- Thanks for participating! --> fill this submission template for me

Agent

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

Most city maps show what a place looks like. Hushmap explores what it sounds like.

It’s a local-first prototype for people who want to notice the soundscape around them. On a walk, you can record a four-second clip or choose a short audio file. Hushmap runs the open YAMNet audio model in your browser and displays broad Birds, Traffic, Water, and People scores. You can save scores privately in your browser or export them.

The map and its suggested walks use clearly labeled illustrative sample data. Hushmap doesn’t yet map real community observations or provide actual routes. The idea is to make a walk an excuse to pause, listen, and learn what sounds are around you.

Demo

Video demo: [Add your recorded demo link before publishing.]

The demo should show local sound classification and make clear that the map is illustrative sample data.

Code

GitHub: [Add your public repository URL before publishing.]

How I Built It

I built the interface as a small JavaScript app and used ONNX Runtime Web to run YAMNet in the browser. The model takes a short mono audio sample, produces AudioSet sound-class scores and embeddings, and Hushmap groups some labels into four broad categories.

The recording is processed in memory and discarded after classification. Scores stay in the browser unless the user saves or exports them. There is also an optional Tiger Data/pgvector integration path that requires a separate consent action and a configured database; I haven’t connected it to a live service.

Why Does Open Innovation Matter?

A neighborhood recording might contain a private conversation or a child’s voice. With a cloud-only classifier, the audio would have to leave the device to get sound labels. Using open model weights lets Hushmap run classification in the browser, so the raw recording can stay local.

Open weights and labels also let builders inspect the model’s vocabulary and adjust how sound labels are grouped. This is a prototype, though: the category scores aren’t calibrated environmental measurements, and the sample map isn’t collected community data.

My Agent Session

Optional: add a DevRelay session link if you save one.


I left out Prize Categories because there isn’t a partner category I can honestly claim yet: Tiger Data hasn’t been connected to a live database, and the app hasn’t been deployed on Render or DigitalOcean.

You

in markdown only

Agent

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

Most city maps show what a place looks like. Hushmap explores what it sounds like.

It’s a local-first prototype for people who want to notice the soundscape around them. On a walk, you can record a four-second clip or choose a short audio file. Hushmap runs the open YAMNet audio model in your browser and displays broad Birds, Traffic, Water, and People scores. You can save scores privately in your browser or export them.

The map and its suggested walks use clearly labeled illustrative sample data. Hushmap doesn’t yet map real community observations or provide actual routes. The idea is to make a walk an excuse to pause, listen, and notice the sounds around you.

Demo

Video demo: [Add your recorded demo link before publishing.]

The demo should show local sound classification and make clear that the map is illustrative sample data.

Code

GitHub: [Add your public repository URL before publishing.]

How I Built It

I built the interface as a small JavaScript app and used ONNX Runtime Web to run YAMNet in the browser. The model takes a short mono audio sample, produces AudioSet sound-class scores and embeddings, and Hushmap groups some labels into four broad categories.

The recording is processed in memory and discarded after classification. Scores stay in the browser unless the user saves or exports them. There is also an optional Tiger Data/pgvector integration path that requires a separate consent action and a configured database; I haven’t connected it to a live service.

Why Does Open Innovation Matter?

A neighborhood recording might contain a private conversation or a child’s voice. With a cloud-only classifier, the audio would have to leave the device to get sound labels. Using open model weights lets Hushmap run classification in the browser, so the raw recording can stay local.

Open weights and labels also let builders inspect the model’s vocabulary and adjust how sound labels are grouped. This is a prototype, though: the category scores aren’t calibrated environmental measurements, and the sample map isn’t collected community data.

My Agent Session

Optional: add a DevRelay session link if you save one.


I left out Prize Categories because there isn’t a partner category I can honestly claim yet: Tiger Data hasn’t been connected to a live database, and the app hasn’t been deployed on Render or DigitalOcean.

You

no give it in markdown format only , and i have uploaded demo at https://youtu.be/EhRVPnIre8A this youtube link

Agent

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

Most city maps show what a place looks like. Hushmap explores what it sounds like.

It’s a local-first prototype for people who want to notice the soundscape around them. On a walk, you can record a four-second clip or choose a short audio file. Hushmap runs the open YAMNet audio model in your browser and displays broad Birds, Traffic, Water, and People scores. You can save scores privately in your browser or export them.

The map and its suggested walks use clearly labeled illustrative sample data. Hushmap doesn’t yet map real community observations or provide actual routes. The idea is to make a walk an excuse to pause, listen, and notice the sounds around you.

Demo

Watch the Hushmap demo on YouTube

The map uses illustrative sample data; the demo shows local sound classification.

Code

GitHub: [Add your public repository URL before publishing.]

How I Built It

I built the interface as a small JavaScript app and used ONNX Runtime Web to run YAMNet in the browser. The model takes a short mono audio sample, produces AudioSet sound-class scores and embeddings, and Hushmap groups some labels into four broad categories.

The recording is processed in memory and discarded after classification. Scores stay in the browser unless the user saves or exports them. There is also an optional Tiger Data/pgvector integration path that requires a separate consent action and a configured database; I haven’t connected it to a live service.

Why Does Open Innovation Matter?

A neighborhood recording might contain a private conversation or a child’s voice. With a cloud-only classifier, the audio would have to leave the device to get sound labels. Using open model weights lets Hushmap run classification in the browser, so the raw recording can stay local.

Open weights and labels also let builders inspect the model’s vocabulary and adjust how sound labels are grouped. This is a prototype, though: the category scores aren’t calibrated environmental measurements, and the sample map isn’t collected community data.

My Agent Session

Optional: add a DevRelay session link if you save one.


I left out Prize Categories because there isn’t a partner category I can honestly claim yet: Tiger Data hasn’t been connected to a live database, and the app hasn’t been deployed on Render or DigitalOcean.

You

this is not markdown

Agent
*This is a submission for the [Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass](https://dev.to/challenges/hacktoberfest-week1-2026-10-05)*

## What I Built

Most city maps show what a place looks like. **Hushmap explores what it sounds like.**

It’s a local-first prototype for people who want to notice the soundscape around them. On a walk, you can record a four-second clip or choose a short audio file. Hushmap runs the open YAMNet audio model in your browser and displays broad Birds, Traffic, Water, and People scores. You can save scores privately in your browser or export them.

The map and its suggested walks use clearly labeled illustrative sample data. Hushmap doesn’t yet map real community observations or provide actual routes. The idea is to make a walk an excuse to pause, listen, and notice the sounds around you.

## Demo

[Watch the Hushmap demo on YouTube](https://youtu.be/EhRVPnIre8A)

The map uses illustrative sample data; the demo shows local sound classification.

## Code

**GitHub:** [Add your public repository URL before publishing.]

## How I Built It

I built the interface as a small JavaScript app and used ONNX Runtime Web to run YAMNet in the browser. The model takes a short mono audio sample, produces AudioSet sound-class scores and embeddings, and Hushmap groups some labels into four broad categories.

The recording is processed in memory and discarded after classification. Scores stay in the browser unless the user saves or exports them. There is also an optional Tiger Data/pgvector integration path that requires a separate consent action and a configured database; I haven’t connected it to a live service.

## Why Does Open Innovation Matter?

A neighborhood recording might contain a private conversation or a child’s voice. With a cloud-only classifier, the audio would have to leave the device to get sound labels. Using open model weights lets Hushmap run classification in the browser, so the raw recording can stay local.

Open weights and labels also let builders inspect the model’s vocabulary and adjust how sound labels are grouped. This is a prototype, though: the category scores aren’t calibrated environmental measurements, and the sample map isn’t collected community data.

## My Agent Session

*Optional: add a DevRelay session link if you save one.*
You

add this demo to readme also and in readme dont tell like its incomplete and what is not there project it like complete and also add for hacktober week 1 challenge

Agent

Updated the README with your YouTube demo and the Hacktoberfest Week 1 challenge. I rewrote it to present Hushmap around its working features and removed the list of absent features, while keeping the sample map clearly labeled as illustrative.

Updated files: README.md and hushmap-local-app.zip.

You

also give proze categories section also at least i am eligible for one of the category

Agent

Added a Hacktoberfest Week 1 Prize Categories section to the README and refreshed the app ZIP.

Hushmap is eligible to be submitted for the overall challenge prize: the challenge asks for open-source AI at the project’s core, and partner technology is optional for the overall prize. Challenge criteria

The README also lists Best Use of Tiger Data as a partner category supported by Hushmap’s pgvector integration. For a stronger category entry, connect Tiger Cloud and capture a successful contribution and similarity search in your demo.

Prize Categories

  • Best Use of Tiger Data: Hushmap includes consent-gated pgvector storage and similarity search for YAMNet embeddings. To demonstrate this partner category, connect Tiger Cloud and show a real contribution and similarity search.

Top comments (0)