Speech language models have emerged as a versatile framework for both understanding and generating spoken language,
excelling across a broad spectrum of tasks. A key challenge in this field is achieving a balance between generation
quality and understanding capacity. To address this, we explore continual pre-training for speech language models within
neural-codec-based systems in this paper. Our experiments focus on continually pre-training a large textual language
model using either speech-only or joint speech-text data. In addition to the original textual model, we conduct extensive
supervised fine-tuning on tasks such as speech recognition, text-to-speech, speech-to-text translation, and speech-to-
speech translation. The results indicate that continual pre-training consistently improves the performance of speech
codec-based language models across both understanding and generation tasks, with particularly notable gains in the complex S2ST task.
Source Speech
Source Text
Target Translation
Target Speech
but we may have one when the future and don't get worry about. it'll have one, sometime we will have one and well no one would tell you once that gonna happen it's.
但我们将来可能会经历一次，不用担心。有时我们会遇到一次，没有人会告诉你它会发生。
we we both had a fair amount of experience in real estate and charlie made his early money in real estate um.
我们在房地产方面都有相当多的经验，查理早期是在房地产行业赚到钱的。
by its nature real estate tends to be a very lousy investment for people who are taxed under sub-chapter c of the ah code relating to corporations so the combination of having it.
就其本质而言，房地产对于那些在与公司相关的法典第C分章下纳税的人来说，是一种非常糟糕的投资组合。
what is the gates foundation doing to fight the corona virus and and why is it such a priority for you?
盖茨基金会在抗击新冠病毒中做了些什么？为什么对你来说这如此重要？
and that makes people nervous about this time. so i think the audience will be so pleased to hear your optimism for this right but.
这让人们对这一次的疫情感到紧张。所以我想观众们会很高兴听到你的乐观态度，但是。
and he said that one of the good qualities any n g o should have any person who wants to be part of a social, you know, service should have is that, ah.
他说任何非政府组织都应该具备的优秀品质之一就是任何想要成为社会一份子的人都应该具备的品质。
and you haven't had the twenty or thirty year period of experience where you're really familiar with the territory.
尽管你对这个领域很熟悉，你没有二、三十年的经验。
or maybe what you want is to write script for detective shows. it doesn't really matter you know what matters is to be is to know what you want.
或者你想要的是为侦探剧写剧本。这并不重要，重要的是知道自己想要什么。
number six, night watch. arguably the most famous artwork of the rich museum in amsterdam.
第六名，《夜巡》。可以说是阿姆斯特丹国立博物馆最著名的艺术品。
and we are allowing food industries to spray it with pesticides, to transport it super far, change its enzymes and nutritional benefits.
我们允许食品工业向食物喷洒杀虫剂，将其运输到很远的地方，改变它的酶和营养价值。
videos every tuesday and friday. at odd occasion, we do this sunday video, what is going on? i'm gonna take a couple of polls.
每周二和周五都更新视频。我们偶尔会在周日更新视频。为何如此呢？我要做几个观众调查。
so you what um so starting from the start there you just grab it in threes and it's just.
所以你从开始的地方把它分成三份，然后它就。
and it just, if it fails, just resort to doing a simple a simple bun. just so it isn't so messy just put it up.
如果失败了，就做一个简单的丸子头。这样就不会太乱了，把它扎起来。
you know this carpet's not good for it anyway. though i don't know how to dance so i'll just jump dad.
你也知道这地毯对它不好。我不会跳舞，所以我就蹦蹦跳跳啦，爸爸。
