Unknown model (beit3_large_patch16_384_retrieval)

[zhishao]

In beit3 project: https://github.com/microsoft/unilm/tree/master/beit3.
Traceback (most recent call last):
File "run_beit3_finetuning.py", line 451, in
main(opts, ds_init)
File "run_beit3_finetuning.py", line 257, in main
model = create_model(
File "/usr/local/lib/python3.8/dist-packages/timm/models/factory.py", line 78, in create_model
raise RuntimeError('Unknown model (%s)' % model_name)
RuntimeError: Unknown model (beit_base_patch16_224)

[rwightman]

@zhishao this isn't a timm issue but the beit3 code / timm versions, I believe you're supposed to be using a beit3 model with that script but they default to a v1

[zhishao]

@rwightman Hi i checked the code , now i got :
Traceback (most recent call last):
File "retrieval_test.py", line 82, in
model = create_model(
File "/usr/local/lib/python3.8/dist-packages/timm/models/factory.py", line 78, in create_model
raise RuntimeError('Unknown model (%s)' % model_name)
RuntimeError: Unknown model (beit3_base_patch16_384_retrieval).

I followed the beit3 code completely, and my timm version is 0.4.12, same as beit3 requirments.txt , i don't know what's wrong.
what i missed ?

[airainday]

I also have same question，Have you solved it yet？

[rwightman]

@airainday this model was never added to the timm lib itself, beit3 used the timm model registry but you have to import beit3 lib in the same package that you import timm lib to in order to have the model registered and available in factory...

[airainday]

thanks, how should I import beit3 lib in the same package

[rwightman]

As long as you import the beit3 module, after importing timm, before calling create_model it should work. But this is so out of date with current timm not 100% sure

…

On Mon, May 13, 2024, 5:48 p.m. airainday ***@***.***> wrote: thanks, how should I import beit3 lib in the same package — Reply to this email directly, view it on GitHub <#1927 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABLQICG27P6D4JM23UXS57DZCFNPBAVCNFSM6AAAAAA3ZSICEKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBZGA3DONBVHA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[airainday]

What exactly do you mean by "beit3 module"? is code of beit3 or pip installation package?

[rwightman]

@airainday sorry, right they never made it into a proper installable module.. they just do this:

https://github.com/microsoft/unilm/blob/8710fec0c4272e8d4898118df5518cb994d258af/beit3/run_beit3_finetuning.py#L19-L29

See that timm create_model is imported ... and then they import their modeling_finetune.py file locally which has the registrations https://github.com/microsoft/unilm/blob/master/beit3/modeling_finetune.py#L277

It's a bit hacky, but basically have to do something like that...

[airainday]

Thank you very much. That's fixed. I didn't import the modeling_finetune.py file before