Ashhadul Islam
Aug 22, 2023

Hello Koushik

Thank you for your questions

1. Yes LLAMA2 can be used for commercial purposes (unless the user base reaches around millions)

2. If we deploy LLAMA2 70B in an AWS g5.48xlarge, the hourly running cost is $23.62 or monthly $17244. (The numbers are obtained from https://betterprogramming.pub/you-dont-need-hosted-llms-do-you-1160b2520526)

The article has a very good comparison between openAI and self hosted LLM

3. Yes LLAMA2 can be trained using the auto train-advanced package from HuggingFace. (Here is a tutorial https://www.youtube.com/watch?v=LslC2nKEEGU)

For more info, you can connect with me on https://www.linkedin.com/in/ashhadul-islam-b508581a/

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Ashhadul Islam
Ashhadul Islam

No responses yet

Write a response