Wednesday, November 24, 2021

Ask HN: Good GPUs for Model Inference

For a local machine to be able to load and serve say 10 different machine learning models (assume model sizes are 500MB to 1GB in size) at the same time, what are good enough GPUs to run classification without worrying about training?


Comments URL: https://news.ycombinator.com/item?id=29334097

Points: 1

# Comments: 0



from Hacker News: Newest https://ift.tt/3xk4Pte
via IFTTT

No comments:

Post a Comment

Show HN: rtrvr.ai – AI Web Agent for Automating Workflows and Data Extraction

Hey HN, I'm excited to share rtrvr.ai, a Chrome extension that brings the power of AI agents to your everyday web browsing. It's de...