While Edge computing has been in the works for some time, it hasn't gotten as much traction as expected; the latest wave of AI may trigger a true adoption of Edge Computing. There are two potential reasons in the context of “smaller” LLMs:
- Privacy
- Availability of Large Scale Compute (Hardware)