Add Flax weights
#19
by
ArthurZ
HF Staff
- opened
Automatically converted PyTorch weights to Flax weights. Using custom function
Those weights correspond to global step 91100 - I kept the tag just in case
I think that the weight map for the flax weights are missing my bad
@ArthurZ Are there tests that need to be run before this can be merged?
I hope it can work well with TPU-v3-32 in the future, this is probably the most cost-effective solution for using Bloom.
Oh sorry for the late reply! Not sure for the tests, I think it worked during the BLOOM FLAX sprint, I can double-check if needed
So what do we do this with this PR? Should we close as it's been a long time and still hasn't been merged without any development?