I suppose I've always been slightly suspicious of modern database technology beyond stodgy stuff like Oracle, SQL Server, MySQL and PostgreSQL, but I'm at the point when I would like to know what my options are.
I don't think my workload is particularly outlandish - 35m events with around 100 attributes, timestamped, some GIS data. Some typical workloads include things like sessionization, grouping events together, and asking questions like "how long after events of type X did an event of type Y happen?", "what was the last event in session Z?", "how long is the path from event A to B to C?" On top of that, all sorts of aggregates get computed over events. Training data gets extracted and predictions fed back in via bits of Clojure or R code.
I am reasonably au fait with modern SQL, I write a lot of window functions, I avoid some common pitfalls, I can generally index my way out of most performance bottlenecks, but my word it feels like a slog some days. So, I suppose my question is this: what am I missing? What fancy new technology exists that can take complex queries, optimise them and give me answers. I don't care about scaling to millions of requests, I don't care about latency, I care about how much time I'm losing looking through EXPLAIN ANALYZE outputs instead of doing real work.