Wednesday, November 24, 2021

Ask HN: Good GPUs for Model Inference

For a local machine to be able to load and serve say 10 different machine learning models (assume model sizes are 500MB to 1GB in size) at the same time, what are good enough GPUs to run classification without worrying about training?


Comments URL: https://news.ycombinator.com/item?id=29334097

Points: 1

# Comments: 0



from Hacker News: Newest https://ift.tt/3xk4Pte
via IFTTT

No comments:

Post a Comment

Size Matters: SpaceX CEO Musk Mocks Russia's 'Familiar' Looking Rocket Prototype

Article URL: https://www.msn.com/en-us/autos/news/size-matters-spacex-ceo-elon-musk-mocks-russias-familiar-looking-amur-rocket-prototype-say...