Next: , Previous: , Up: Embedding Migration   [Contents][Index]

11.6 Monitoring progress

11.6.1 Status query

To see what state the store is currently in: 

SELECT embedding_provider, embedding_model, count(*)
FROM memories
GROUP BY 1, 2
ORDER BY count(*) DESC;

Mid-walk this returns two rows (old and new), shifting as the walker progresses. After completion it returns one row.

11.6.2 Rows still needing re-embed

SELECT count(*) FROM memories
WHERE embedding IS NULL
   OR embedding_provider IS DISTINCT FROM 'openai'
   OR embedding_model    IS DISTINCT FROM 'text-embedding-3-large';

11.6.3 Watching the walker live

journalctl -u ownsona.service -f | grep -E 'reembed:|migrator:'

The reembed: progress count=N lines tick by once per batch (50 rows by default).