Add Distributions integration tests

[mhauru]

Runs logpdf on a lot of different distributions, compares against FiniteDifferences.

Currently generating a lot of failures. Need to investigate which ones should be reported as bugs, which ones should just be marked as broken because of e.g. missing foreign calls.

Largely copied from similar tests in Tapir: https://github.com/compintell/Tapir.jl/blob/main/test/integration_testing/distributions.jl

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 75.47%. Comparing base (037dfed) to head (81b24fe).
Report is 333 commits behind head on main.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1819      +/-   ##
==========================================
+ Coverage   67.50%   75.47%   +7.96%     
==========================================
  Files          31       45      +14     
  Lines       12668    16054    +3386     
==========================================
+ Hits         8552    12117    +3565     
+ Misses       4116     3937     -179     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[wsmoses]

@mhauru @yebai from the quadgk version incompatability, I think this should just be done in DistributionsAD.jl?

In any case, open any issues that persist and we'll get them fixed quickly

[mhauru]

This is ready for review. I've marked all failing tests as broken and opened issues for them. The univariate distributions are doing well, except for some missing foreign calls that were already known. There's still quite a lot of breakage for multivariate and matrix variate distributions.

Here are all the relevant issues:

• Missing Rmath derivatives #1620
• Implement besseli #1603
• [ForwardMode] unimplemented derivative for trtrs #1991
• Forward mode gradient error with argument of limited mutability #1821
• Missing rule for LAPACK's dgetrf_64_ #1820
• [ForwardMode] Runtime Activity not supported for BLAS calls #1995
• LLVM error: function failed verification (4) on truncated Beta distribution #1996
• Incorrect forward mode gradient for truncated normal distribution #1998
• BatchDuplicated fails with RefValues #1997
• Forward mode gradient doesn't support tuples with varying element types #1994

EDIT:
Also

• julia crash, Illegal Instruction 4, Wishart distribution #2012
• no method matching reverse with truncated Beta distribution #2010

[mhauru]

Fixed the two issues you pointed out. Tests now locally crash julia with Illegal instruction, not sure why, probably something that has changed on main. Will investigate tomorrow.

[mhauru]

Commented out the one that crashes and made an issue about it. Tests pass locally again, ready for another look, @wsmoses.

[mhauru]

I'm unable to reproduce locally that last test failure, despite using the same Julia and dependency versions. Could something here be platform dependent?

[yebai]

I'm unable to reproduce locally that last test failure, despite using the same Julia and dependency versions. Could something here be platform dependent?

Maybe consider running these integration tests in a broader range of platforms by default.

[mhauru]

Tests pass locally for me, but hang for 6 hours on CI and time out. @wsmoses any ideas for what might be going on? Would you have a Linux machine to test this locally?

[mhauru]

@wsmoses could we see if we can make progress here? Testing Turing.jl is much more fruitful if we have confidence in individual distributions being fine. This is still in a state where tests pass for me locally but hang on CI. Could you try running them on any non-Mac machines you have available to see what happens?

[wsmoses]

honestly no clue/fruit from my end either, probably the way to debug this is to binary search in CI selectively removing half the tests each time until we find what is the one going awry