Large Generative AI Development Support Program
ABCI has been implementing the “ABCI Grand Challenge” program to support the challenges of the most important issues in the field of artificial intelligence, which are only possible through enormous computing power, and important social issues utilizing artificial intelligence, big data, and quantum computation.
In FY2023, the “Large-scale Language Model Building Support” program was conducted against the backdrop of the growing demand for large-scale language models.
In FY2024, we will expand the scope of the program from language models to include all aspects of building the “Large-scale Generative AI Models,” including large-scale language models and diffusion models.
ABCI limits the number of parallel jobs and their execution time in order to avoid excessively long waiting times for jobs.
However, this limitation makes it difficult to run jobs that require a huge amount of computation, such as large-scale generative AI models.
This program enables users who wish to build large-scale generative AI models to reserve a larger number of compute nodes.
Please note that ABCI points should be obtained in charge by the ABCI users to execute this program.
Unlike the Grand Challenge, no free ABCI points will be granted.
Public Application Guidelines
Eligibility
- We are looking for R&D themes related to the construction of large-scale generative AI models that require the exclusive use of a large number of nodes for a long period of time. Themes that can be sufficiently executed in a normal execution environment are not eligible.
- Proposals will be publicly solicited, and proposals can be submitted by individuals or groups affiliated with domestic corporations.
- We plan to adopt several proposals from among those that are publicly solicited.
Resources to be provided
- Compute Node (A) will be provided. The number of node is 120.
- The maximum duration is 140 days. This is approximately 195 days from mid-April to the shutdown of ABCI on October 31, excluding maintenance and the 55-day buffer period around that time.
- Please indicate the amount of resources you would like to use by multiplying the number of nodes by the number of days. The number of nodes and days to be allocated may be adjusted at the time of selection.
Notes
- Users are responsible for ABCI points (the billing coefficient for the reserved use of Compute Node (A) will be applied). No free points will be granted.
- If you do not have an ABCI account, you are required to submit an “ABCI Application” after the theme is adopted.
- The reservation period may include a period of suspension for maintenance. In such cases, the reservation period will be extended to the date that extends the number of days of the shutdown period (and the buffer period before and after the shutdown period).
Cost
- If your proposal is selected, you will be required to obtain the ABCI points necessary to reserve a node (A). The number of points required is “number of nodes to be allocated × hours × Node A billing coefficient (6) × 1.5.
- In the case of a research theme conducted by a public institution, the number of points to be charged will be discounted by 33% (the number of points required is “number of nodes allocated x hours x Node A billing coefficient (6)”). Here, public institutions refer to national research and development corporations, inter-university research institute corporations, national, public or private universities, public testing and research institutes, and colleges of technology. If unclear, please contact us.
- The above number of points will be deducted at the time of reservation. Points will not be returned if the node is not actually used for the user’s circumstances.
- Some of the resources scheduled to be provided may not be available for reasonable reasons, such as in response to node failure. Please determine the desired number of nodes in consideration of spare nodes. If a node cannot be used due to node failure, etc., the number of points equivalent to the node time product that cannot be used will be returned.
Proposal Review
Proposals will be reviewed by the Large-Scale Generation AI Research and Development Support Program Review Committee, consisting of experts, through document review and discussion based on the results of the review.
The main items to be reviewed are as follows:
- Academic or social impact
- Public nature of the research
- Feasibility and appropriateness of the plan
- Implementation structure and plan
Application Deadlines
- First deadline: April 1, 2024 11:59pm
- Applications will be accepted on an ongoing basis as long as there are sufficient resources available.
How to apply
∗ Acceptance of applications has been closed. Thank you for so many applications.
Please submit your application using this form (https://forms.office.com/r/ELgxU0xqJe). (Sorry, Japanese only.)
Please refer to the application form below for input items. (Sorry, Japanese only.)
Contact information
ABCI Contact: application@abci.ai
Accepted Proposals (Sorry, Japanese only.)
| Organization |
Proposal |
Number of nodes |
Days |
| 国立研究開発法人産業技術総合研究所 |
継続事前学習に基づく汎用性および有用性の高い日本語大規模言語モデルの構築 |
36 |
140 |
| 国立研究開発法人情報通信研究機構 |
世界最大級の高品質日本語データ構築法の探索およびそのデータに適した事前学習ハイパーパラメータの探索 |
32 |
100 |
| 国立研究開発法人産業技術総合研究所 |
日本語音声と話し言葉に強い音声音響基盤モデルの構築 |
20 |
70 |
| 株式会社ELYZA |
実践的応用を視野に入れた日本語大規模言語モデルの開発: 知識と系列長の拡張 |
40 |
70 |
| 国立研究開発法人産業技術総合研究所 |
データの倫理問題を根本解決するテキストからの画像生成モデル構築 |
40 |
21 |
| 理化学研究所 |
AI for Science実現に向けた科学基盤モデルの構築 |
2 |
140 |
Listed in order of receipt of applications.
