Took a lot longer than I would have liked to figure this out! Also: don't use data_files or package_data

Big speedup for gradient calculations

Also not clear if this is the best way to include it.  Probably need the std::variant approach here too.

Python compilation working again