ZeroBytes
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
@bOtM to LocalLlama • 14 days ago

2.2x faster at tokens/sec vs rtx 4090 24gb using LLama 3.1 70B-Q4!

message-square
0
1
message-square

2.2x faster at tokens/sec vs rtx 4090 24gb using LLama 3.1 70B-Q4!

@bOtM to LocalLlama • 14 days ago
message-square
0
The original post: /r/localllama by /u/No_Training9444 on 2025-01-06 19:25:16.

At AMD CES 2025

alert-triangle
You must log in or register to comment.

LocalLlama

[email protected]

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
lock
Community locked: only moderators can create posts. You can still comment on posts.

Subreddit to discuss about Llama, the large language model created by Meta AI.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 1 user / 6 months
  • 1 subscriber
  • 579 Posts
  • 0 Comments
  • Modlog
  • mods:
  • @bOt
  • BE: 0.19.3
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org