Drawing from my experience, modern technologies like Hotwire and Turbo Frames—when integrated with background jobs and Action Mailbox for handling inbound emails—alongside mature tooling, create a surprisingly effective (and enjoyable) platform for developing AI applications.
I attempted to implement this on the front end of my e-commerce site, which has approximately 20,000 products (see gist [1]). My goal was to enhance search speed by performing as many local operations as possible.
Biggest impact in performance was by moving to dot products.
Regrettably, the sheer size of the index of embeddings rendered it impractical to achieve the desired results.
reply