Launch HN: Deepsilicon (YC S24) – Software and hardware for ternary transformers
Hey Hacker News! We’re Abhi and Alex from deepsilicon ( https://deepsilicon.com ). We are building software and hardware for training and inferencing ternary transformer models. Here's a video of the software: https://www.youtube.com/watch?v=VqBn-I5D6pk . Transformer-based models are getting bigger every generation, making the inference hardware requirements more and more expensive. Running large transformer models on device is even more challenging. Usually, they require trillions of FLOPs to run at decent speeds and use too much energy and space. Our solution is to train ternary transformer models. There are two advantages to using ternary values. The first is that the weights can now be stored in two bits (or even less) from 16 bits. This represents an almost 8x compression ratio for every weight matrix in the transformer model (slightly less because of t
Why it failed
Hey Hacker News! We’re Abhi and Alex from deepsilicon ( https://deepsilicon.com ). We are building software and hardware for training and inferencing ternary transformer models. Here's a video of the software: https://www.youtube.com/watch?v=VqBn-I5D
- Kind
- startup
- Status
- Shut down
- Inventor
- areddyyt
- Ended
- 2024
- Source
- hackernews