metadata: {"signature": "0x91b4b347b27eba1fe4dfd762bbe3670c9a5981fb2ab022a2e50118880473ac7d767f2e8ec31e6536063c69510b1bb9f459f952ddf74847677e937d86b0768c371b", "application": {"round": "0x6142eedc06d80f3b362ce43b4ac52fad679dc850", "answers": [{"type": "email", "hidden": true, "question": "Email Address", "questionId": 0, "encryptedAnswer": {"ciphertext": "W+XjUtAj1WRzjDTDRBSXkI3KYeIn9YB85C/RIw6lV1Pzi2G5Ffd2aN36zVfRD0yr", "encryptedSymmetricKey": "6b4e90794ad80886041e868d9a4bff070d653e709b64f163517f0a3b4df031dae11d8ee3efe117e7aec1fdad97d4530835864b82cbff70e6af209cdd133d3fd09aaabd31072690ee31c61ddd3033cbed6f23d5a17a5e5441105683853e2e51b263ae16b75869e49ec1ed257cde8e0a735b2bb8324eabd2dbdac90ead04f1e59400000000000000207584ba08d0dd125bc4cb0d454de08d79b13982993ec8cf0d43b6ce9cf023e027255255a685839f78dbacb9244e36d9b4"}}, {"type": "paragraph", "answer": "Type2Vid.ai The first AI technology platform to empower Web3 projects\n\nThe most advanced AI text-generated video large multimodal model, the user threshold is low and the cost of use is low.\nType2Vid is an aggregation platform that empowers Web 3 projects with AI technology and continuously issues new AI Base projects.\nIn the future, decentralized GPU power AIOS will be developed and $TYPE tokens will be issued to make it accessible to users around the world.\n\nPlease see our presentation that accompanies this proposal:\nhttps://docsend.com/view/k54rixcxuxxk5dfw\n\nType2Vid.ai through the use of neural networks and rendering technology to achieve realistic character video synthesis. The user inputs the text content expected to be spoken by the target speaker, and the text content will be converted into the audio of the target speaker's timbre. The output speech is natural, expressive, and indistinguishable from the target speaker's voice. Then use the audio to edit the head video of the target speaker to generate a high-quality and lip-synced output video that is consistent even under different emotions.\n\n1. Extract the source audio speech feature: \nFirst, perform pre-training to extract the source audio speech feature from the target speaker's voice source file to form an audio corpus, support users to directly input text, directly convert text to speech through the function of TTS, and then the extracted audio speech feature is given to the speech file converted by text.\n\n2. Predict facial shapes and textures: \nSecondly, predict facial shapes and textures from a single image of the target speaker. \n\n3. Lip synchronization is applied to the source video: \nFinally, the face shape that needs to be matched with the speech content predicted by the voice file generated in the first step is applied to the source video to achieve lip synchronization. \n\nType2Vid.ai provides text-generated video to build basic models for global users, and continues to improve and optimize, and will support more languages in the future, including Spanish, Russian, Japanese, Korean..., providing top-level text-generated speech, voice cloning, voice fusion with lip movements and expressions, and other cutting-edge AI technologies.\n\nAdvantages and applications: The lip synchronization algorithm proposed by Type2Vid can not only achieve realistic lip synchronization while maintaining the target speaker's expression, head posture and other features, but also has a wide range of application prospects in video-related industries. Let's take a deeper look:\nWidely used domain: It can be applied to domains such as movies, short videos, advertisements, education, training, virtual reality, conferences, etc. For example:\n- In entertainment such as live broadcasts and short videos, the real person can record the video of any voice content in advance, and only needs to change the text content each time, which can quickly generate new live broadcasts or short video content without the process of shooting and editing.\n- In advertising, the spokesperson can record the video in advance, and the advertiser can enter the text at any time to create a new advertising video based on the spokesperson according to the different needs of different stages, without the spokesperson re-shooting and editing the video advertisement.\n- In the field of education and training, it can be used by real teachers to create interactive learning experiences, improve the learning effect and have fun.\n- In filmmaking, this technology can help make film dubbing more realistic.\n- In virtual reality, technology can enhance the user's immersion and experience.\n- In scenarios such as remote meetings, this technology can make communication between participants more natural and authentic.\n- In translation, technology translates the entire video into different languages or modifies the voice after the video is recorded.\n\nType2Vid.ai will ultimately establish a decentralized GPU computing platform based on the Solana blockchain. Users participate in Type2Vid text generation video-related computing work according to hardware configuration requirements, realize decentralized data computing architecture. Ultimately, the following goals are achieved:\n- Consistent use of data and information\n- Data deletion after processing\n- Anonymization of sensitive personal or business data", "hidden": false, "question": "Application detail", "questionId": 1}, {"type": "number", "answer": "50000", "hidden": true, "question": "Amount requested (in $)", "questionId": 2}, {"type": "dropdown", "answer": "ARB", "hidden": true, "question": "Payout token", "questionId": 3}, {"type": "short-answer", "answer": " The funds will primarily be used to cover the costs of GPU computing services required for text-to-video generation.", "hidden": true, "question": "How do you account for this fund request?", "questionId": 4}, {"type": "paragraph", "answer": "Type2Vid has already launched its beta version, allowing users to participate in the experience. All funds will be used to cover GPU server costs, with the approximate GPU computing cost for generating one minute of video being around $1. \n\nWith the support of funds, user experience will be opened up, allowing users to pay with USDC to experience text-to-video generation. Additionally, $TYPE tokens will be distributed to all users generated in video creation(estimated time to complete: 5 Days)", "hidden": false, "question": "How will you use these funds? Please make a detailed plan for expenditures.", "questionId": 5}, {"type": "dropdown", "answer": "Open Contribution", "hidden": false, "question": "Which RFP is this project covering? ", "questionId": 6}, {"type": "short-answer", "answer": "Very well-suited to Uniswap, as users have a strong interest in AI technology and text-to-video generation. Therefore, there will be a significant demand for Type2Vid.ai's $TYPE token, and Uniswap serves as the most convenient platform for token transactions.", "hidden": false, "question": "How do you think this project fits in with Uniswap?", "questionId": 7}, {"type": "paragraph", "answer": "\nIn Type2Vid.ai's plan, the platform will ultimately establish a decentralized GPU computing infrastructure based on the Solana blockchain. Users will engage in Type2Vid text generation video-related computing tasks based on hardware configuration requirements, thereby realizing a decentralized data computing architecture.\n\nThis will generate significant demand for the $TYPE token, and Uniswap will serve as the most convenient platform for users to quickly trade $TYPE tokens.", "hidden": false, "question": "What benefits will this project bring to Uniswap in the Arbitrum ecosystem?", "questionId": 8}, {"type": "short-answer", "answer": "Planning", "hidden": true, "question": "Has this project undergone a security audit? If not, are you planning to undergo it?", "questionId": 9}, {"type": "short-answer", "answer": "No", "hidden": false, "question": "Is this project open-source? (If yes, share the repository link).", "questionId": 10}, {"type": "paragraph", "answer": "Type2vid.ai follows the following workflow:\n\nDevelopment Practices: We adopt an agile development approach, continuously optimizing the product through iterations and feedback. The team places a strong emphasis on user experience to ensure that our product meets user requirements.\n\nTools: We utilize modern development tools and technologies to support project development, including version control tools (Git), collaboration platforms (Lark), and project management tools (also Lark), to enhance team collaboration efficiency.\n\nProgramming Languages: Our primary programming language is Python, chosen for its widespread applications in artificial intelligence and machine learning. Additionally, we use various web development technologies such as HTML, CSS, and JavaScript.The contract development language used is Solidity.\n\nAI Model Development: We employ deep learning frameworks TensorFlow and PyTorch for the development and training of AI models. This contributes to achieving high-quality text-to-video generation.\n\nThe selection of these workflows aims to ensure the efficient development and delivery of the project, guaranteeing outstanding performance and user experience in the final product.", "hidden": true, "question": "What is the workflow chosen for this project? (You can mention development practices, tools, programming languages, etc.)", "questionId": 11}, {"type": "short-answer", "answer": "Https://www.type2vid.ai", "hidden": true, "question": "Does this project have a demo? If yes, share a public link.", "questionId": 12}, {"type": "short-answer", "answer": "The target users are those who do not possess AI experience and coding capabilities, including both Web2 and Web3 users. The goal is to let them experience the powerful allure of AI technology by generating videos through text input without requiring AI expertise or coding skills. With Type2Vid.ai's conversational text input and user-friendly experience, users only need to input text to generate a video.   Type2Vid.ai is the first Web3 project with the capability of text-to-video AI. Unlike other Web3 AI projects that make it challenging for users to experience their claimed AI technology and involve significant marketing costs, often resorting to Ponzi economic models to attract users, Type2Vid.ai offers a low entry barrier for users. This allows them to experience the product easily without requiring expertise in AI or coding ability.  The more users experience the product, the more confidence they gain in Type2Vid.ai. This confidence enables the Type2Vid.ai team to allocate more time and energy to the development of new AI models, continuously providing users with more AI application experiences.", "hidden": true, "question": "What is the target audience for this project? (Mention if there is a market launch plan).", "questionId": 13}, {"type": "paragraph", "answer": "Gray Kuo: CEO\nJason Luo: Chief Scientist\nChris Shi: CTO", "hidden": false, "question": "Who are the members of the team?", "questionId": 14}, {"type": "paragraph", "answer": "The team has three main co-founders:\n\nGray Kuo: Primarily responsible for business model design and marketing.\nJason Luo: Primarily responsible for AI model development and applications, as well as operational work.\nChris Shi: Primarily responsible for website and contract development.", "hidden": true, "question": "Describe team members' experience and current roles for this project.", "questionId": 15}, {"type": "paragraph", "answer": "In December 2023, Type2Vid.ai V1 website was launched.\nIn March 2024, Video support will be gradually launched in Spanish, Russian, Japanese, and Korean.\nIn March 2024, Third-party API access services will be opened, allowing other websites, APPs and Mini Programs to embed Type2Vid AI models to provide service.\nIn April 2024, the Type2Vid DAO was established to be fully responsible for the operation of Type2Vid.ai.\nIn June 2024, TYPE tokens will be issued to distribute tokens to paid video making users.\nBy the end of 2024, we will ultimately establish a decentralized GPU computing platform", "hidden": false, "question": "What are the Project Milestones? (Be very specific and write a roadmap highlighting critical deliverables of the project; mention how you will ensure to supervise and track them).", "questionId": 16}, {"type": "paragraph", "answer": "Type2Vid.ai's AI text-to-video generation has already launched its beta version and is available for direct experience on the website. After receiving the grant, we will open up user experiences and airdrop $TYPE tokens to all users who generate videos. Currently, there are no technical obstacles.\n\nAdditionally, due to the viral marketing nature of AI-generated videos, our videos carry a Type2Vid.ai URL watermark, facilitating rapid dissemination and encouraging user participation.", "hidden": false, "question": "How do you plan to reach these milestones? (Explain the project feasibility).", "questionId": 17}, {"type": "multiple-choice", "answer": "No", "hidden": true, "question": "Has this project already been funded by other Grant Programs?", "questionId": 18}, {"type": "checkbox", "answer": ["I confirm."], "hidden": true, "question": "I confirm that I have read the Code of Conduct and that I have filled out this form correctly and truthfully.", "questionId": 19}, {"type": "checkbox", "answer": ["I understand."], "hidden": true, "question": "I understand that I will be required to provide KYC information by the UAGP team in case my application is accepted.", "questionId": 20}, {"type": "short-answer", "answer": "Twitter", "hidden": true, "question": "How did you find out about UAGP?", "questionId": 21}, {"type": "paragraph", "answer": "As Type2Vid evolves to the next stage, the text-to-video capabilities will be packaged into an API, available for other developers. \n\nThis empowerment aims to support other projects interested in providing AI experiences for Arbtrium One users.", "hidden": true, "question": "Additional information", "questionId": 22}, {"type": "short-answer", "answer": "No Special requests", "hidden": true, "question": "Special requests", "questionId": 23}], "project": {"id": "42161:0x73AB205af1476Dc22104A6B8b3d4c273B58C6E27:418", "title": "Type2Vid", "logoImg": "bafkreibb3wagqmxbo4blpatdzx3pz5pjjihoj7ab2hgdyuhdovp5ugqpya", "metaPtr": {"pointer": "bafkreigzxthzv6urpojvm7wt4v5vemdxqila7cwuwkocgzficcrxf2klri", "protocol": "1"}, "website": "https://www.type2Vid.ai", "bannerImg": "bafkreicwcg45oefh5bc5mtyxcvxsxxaoacoskhpriurigqdklcpft5r72a", "createdAt": 1703861819698, "credentials": {"twitter": {"type": ["VerifiableCredential"], "proof": {"jws": "eyJhbGciOiJFZERTQSIsImNyaXQiOlsiYjY0Il0sImI2NCI6ZmFsc2V9..Z3IOW70PZ9tPrMC3zHlBV6LTSneX_pQC1WejMZW_zbvhccf5vdneS2isOYTLwxuxtbJB3qd-ovqohRRy7150Cw", "type": "Ed25519Signature2018", "created": "2023-12-29T14:49:04.583Z", "proofPurpose": "assertionMethod", "verificationMethod": "did:key:z6MkghvGHLobLEdj1bgRLhS4LPGJAvbMA1tn2zcRyqmYU5LC#z6MkghvGHLobLEdj1bgRLhS4LPGJAvbMA1tn2zcRyqmYU5LC"}, "issuer": "did:key:z6MkghvGHLobLEdj1bgRLhS4LPGJAvbMA1tn2zcRyqmYU5LC", "@context": ["https://www.w3.org/2018/credentials/v1"], "issuanceDate": "2023-12-29T14:49:04.583Z", "expirationDate": "2024-03-28T14:49:04.583Z", "credentialSubject": {"id": "did:pkh:eip155:1:0xcD6F0E15cA8AdecbC7c0CEdb7b2997E488888888", "hash": "v0.0.0:nRy5pbBrBG2xR/DdUG5DC347VpHfpffVvoyt4450tRA=", "@context": [{"hash": "https://schema.org/Text", "provider": "https://schema.org/Text"}], "provider": "ClearTextTwitter#type2vid"}}}, "description": "Type2Vid.ai The first AI technology platform to empower Web3 projects\n\nThe most advanced AI text-generated video large multimodal model, the user threshold is low and the cost of use is low.\nType2Vid is an aggregation platform that empowers Web 3 projects with AI technology and continuously issues new AI Base projects.\nIn the future, decentralized GPU power AIOS will be developed and $TYPE tokens will be issued to make it accessible to users around the world.\n\nPlease see our presentation that accompanies this proposal:\nhttps://docsend.com/view/k54rixcxuxxk5dfw\n\nType2Vid.ai through the use of neural networks and rendering technology to achieve realistic character video synthesis. The user inputs the text content expected to be spoken by the target speaker, and the text content will be converted into the audio of the target speaker's timbre. The output speech is natural, expressive, and indistinguishable from the target speaker's voice. Then use the audio to edit the head video of the target speaker to generate a high-quality and lip-synced output video that is consistent even under different emotions.\n\n1. Extract the source audio speech feature: \nFirst, perform pre-training to extract the source audio speech feature from the target speaker's voice source file to form an audio corpus, support users to directly input text, directly convert text to speech through the function of TTS, and then the extracted audio speech feature is given to the speech file converted by text.\n\n2. Predict facial shapes and textures: \nSecondly, predict facial shapes and textures from a single image of the target speaker. \n\n3. Lip synchronization is applied to the source video: \nFinally, the face shape that needs to be matched with the speech content predicted by the voice file generated in the first step is applied to the source video to achieve lip synchronization. \n\nType2Vid.ai provides text-generated video to build basic models for global users, and continues to improve and optimize, and will support more languages in the future, including Spanish, Russian, Japanese, Korean..., providing top-level text-generated speech, voice cloning, voice fusion with lip movements and expressions, and other cutting-edge AI technologies.\n\nAdvantages and applications: The lip synchronization algorithm proposed by Type2Vid can not only achieve realistic lip synchronization while maintaining the target speaker's expression, head posture and other features, but also has a wide range of application prospects in video-related industries. Let's take a deeper look:\nWidely used domain: It can be applied to domains such as movies, short videos, advertisements, education, training, virtual reality, conferences, etc. For example:\n- In entertainment such as live broadcasts and short videos, the real person can record the video of any voice content in advance, and only needs to change the text content each time, which can quickly generate new live broadcasts or short video content without the process of shooting and editing.\n- In advertising, the spokesperson can record the video in advance, and the advertiser can enter the text at any time to create a new advertising video based on the spokesperson according to the different needs of different stages, without the spokesperson re-shooting and editing the video advertisement.\n- In the field of education and training, it can be used by real teachers to create interactive learning experiences, improve the learning effect and have fun.\n- In filmmaking, this technology can help make film dubbing more realistic.\n- In virtual reality, technology can enhance the user's immersion and experience.\n- In scenarios such as remote meetings, this technology can make communication between participants more natural and authentic.\n- In translation, technology translates the entire video into different languages or modifies the voice after the video is recorded.\n\nType2Vid.ai will ultimately establish a decentralized GPU computing platform based on the Arbitrum One blockchain. Users participate in Type2Vid text generation video-related computing work according to hardware configuration requirements, realize decentralized data computing architecture. Ultimately, the following goals are achieved:\n- Consistent use of data and information\n- Data deletion after processing\n- Anonymization of sensitive personal or business data", "lastUpdated": 0, "projectTwitter": "type2vid"}, "recipient": "0xcD6F0E15cA8AdecbC7c0CEdb7b2997E488888888"}}