SCRP-Chat: On-premise Generative AI Service
After a one-and-a-half month trial period, we are glad to formally introduce SCRP-Chat, a service offering state-of-the-art generative AI models on the Department of Economics’ SCRP computer cluster. Potential uses of the models include large-scale natural language processing, automated coding, essay editing and image recognition.
There will be a 1-hour workshop at our conference room (ELB 918) on Nov 25, 2024 (Mon) from 12:30pm introducing the service, with demonstrations on how to use it for a variety of tasks.
Benefits of using SCRP-Chat
-
Browser and API access to state-of-the-art models with text and vision capabilities.
-
Information passed to the models never leaves our on-premise servers, making it suitable for processing proprietary data.
-
High performance—up to 60 tokens per second per query for Llama 3.1 70B, and 200 tokens per second per query for Llama 3.2 1B.
-
Free for SCRP users.
How to use SCRP-Chat?
Simply log in to https://scrp-chat.econ.cuhk.edu.hk with your SCRP account to use the service.
For details such as model selection and API access, please refer to the documentation.