pagination issues with sqlalchemy count() vs all()

[martenson]

Because of this sqlalchemy quirk our grids pagination has issues in some places e.g. on workflowlist. I am not sure yet what causes the duplication which query.all() removes but one of the effects is that page sizes are not consistent (i.e. you get 12 results for a limit of 15).

Relatedly the total_matches reported to the caller through headers is in my observation also inconsistent with reality.

in workflows case we return query.count()=X here but once query.all() is called the count is not guranteed

The initial and final statements look like this: https://gist.github.com/martenson/5beaf3fd4aa952db7c5ae8b285448471
The limit() is is applied in the inner select so I think (?) that should be where the duplication is present.

On my DB with limit 5 the second query has .count()=5 and .all() gives you 3 workflows.