Question
3
Replies
38
Views
Posted: July 13, 2020
Last activity: July 13, 2020
Maximum no.of ADM Models instances to be created in an ideal CDH implementation
Hi All,
I would like to know what is the maximum number of ADM Models can be created at run time in a CDH application.
I am trying to build ADM Model by adding one additional context variable along with default 5 context variable. This 6th variable may have lot of variable values which would be making those many ADM model instances created in the system.
This number could be more than 1 lac. Will it be ok to create those many number of ADM Models ?
Thanks in advance.
ADM scales horizontally so theoretically this could work. However, > 100.000 models is a lot more than we usually see, and the computational performance, sizing and storage requirements need to be thought through carefully. If each of these 100.000 models has say 100 inputs, you'll be carrying around the statistics for 10.000.000 fields. That is a lot.
But perhaps even more important than computational performance: you need to wonder whether defining models at this level of granularity will give the models enough evidence to learn from. If you make them too specific, they won't be able to generalize and learn.
So the question is really: why would you want to do this? What is your use case? And what volumes/response rates would you expect?
Thanks
Otto