Parallelize the server compute

[glebfann]

Following up on this comment. This would be really helpful for those trying to scale, as any performance improvements are valuable :)

Not today, though it should be relatively straightforward to parallelize the server compute in a few places:
here
here
here

[karulont]

There are multiple ways to scale & parallelize.

If you want to get the lowest latency for a single query, we would need to parallelize the server compute.
However, if you need highest throughput (many queries) parallelizing inside individual queries likely does not help.

[glebfann]

Yeah, I meant the first option - reducing latency for a single query. Any performance improvement would be valuable anyway.
Seems like it also could be a good first issue to tackle.