We mostly work with NLP and NLU.
Large language models including
OpenAI GPT-3
Bloom
BloomZ
GPT-J 6B
LLaMA
Alpaca, etc.;
HuggingFace Transformers, Accelerate;
Petals, Deepspeed, zfp/zfpy;
CUDA, CPU, and MPS (AArch 64 M2 MacOS Metal GPU) backends.
Apple Neural Engine (ANE).
XGBoost for predictions (including trading), LibSVM, TensorFlow, PyTorch, Scikit-learn, etc.