New Trends for Modern Machine Translation with Large Reasoning Models
Paper
•
2503.10351
•
Published
•
18
AI & ML interests
None defined yet.
Recent Activity
View all activity
Qwen's activity
minghaowu
authored
a
paper
2 days ago
hzhwcmhf
updated
a
model
3 days ago
Create params
1
#4 opened 6 days ago
by
jklj077
hiyouga
authored
2
papers
4 days ago
clefourrier
posted
an
update
4 days ago
Post
1593
Gemma3 family is out! Reading the tech report, and this section was really interesting to me from a methods/scientific fairness pov.
Instead of doing over-hyped comparisons, they clearly state that **results are reported in a setup which is advantageous to their models**.
(Which everybody does, but people usually don't say)
For a tech report, it makes a lot of sense to report model performance when used optimally!
On leaderboards on the other hand, comparison will be apples to apples, but in a potentially unoptimal way for a given model family (like some user interact sub-optimally with models)
Also contains a cool section (6) on training data memorization rate too! Important to see if your model will output the training data it has seen as such: always an issue for privacy/copyright/... but also very much for evaluation!
Because if your model knows its evals by heart, you're not testing for generalization.
Instead of doing over-hyped comparisons, they clearly state that **results are reported in a setup which is advantageous to their models**.
(Which everybody does, but people usually don't say)
For a tech report, it makes a lot of sense to report model performance when used optimally!
On leaderboards on the other hand, comparison will be apples to apples, but in a potentially unoptimal way for a given model family (like some user interact sub-optimally with models)
Also contains a cool section (6) on training data memorization rate too! Important to see if your model will output the training data it has seen as such: always an issue for privacy/copyright/... but also very much for evaluation!
Because if your model knows its evals by heart, you're not testing for generalization.
littlebird13
updated
a
model
4 days ago
Post
1047
🙋🏻♂️Hey there folks,
Did you know that you can use ModernBERT to detect model hallucinations ?
Check out the Demo : Tonic/hallucination-test
See here for Medical Context Demo : MultiTransformer/tonic-discharge-guard
check out the model from KRLabs : KRLabsOrg/lettucedect-large-modernbert-en-v1
and the library they kindly open sourced for it : https://github.com/KRLabsOrg/LettuceDetect
👆🏻if you like this topic please contribute code upstream 🚀
Did you know that you can use ModernBERT to detect model hallucinations ?
Check out the Demo : Tonic/hallucination-test
See here for Medical Context Demo : MultiTransformer/tonic-discharge-guard
check out the model from KRLabs : KRLabsOrg/lettucedect-large-modernbert-en-v1
and the library they kindly open sourced for it : https://github.com/KRLabsOrg/LettuceDetect
👆🏻if you like this topic please contribute code upstream 🚀
- 2 replies
Losin94
authored
a
paper
9 days ago
JustinLin610
authored
a
paper
9 days ago
huybery
authored
a
paper
9 days ago
Zhenru
authored
a
paper
9 days ago
Post
660
Powered by
KRLabsOrg/lettucedect-large-modernbert-en-v1 from KRLabsOrg.
Detect hallucinations in answers based on context and questions using ModernBERT with 8192-token context support!
### Model Details
- **Model Name**: [lettucedect-large-modernbert-en-v1]( KRLabsOrg/lettucedect-large-modernbert-en-v1)
- **Organization**: [KRLabsOrg](https://huggingface.co/KRLabsOrg)
- **Github**: [https://github.com/KRLabsOrg/LettuceDetect](https://github.com/KRLabsOrg/LettuceDetect)
- **Architecture**: ModernBERT (Large) with extended context support up to 8192 tokens
- **Task**: Token Classification / Hallucination Detection
- **Training Dataset**: [RagTruth]( wandb/RAGTruth-processed)
- **Language**: English
- **Capabilities**: Detects hallucinated spans in answers, provides confidence scores, and calculates average confidence across detected spans.
LettuceDetect excels at processing long documents to determine if an answer aligns with the provided context, making it a powerful tool for ensuring factual accuracy.
Detect hallucinations in answers based on context and questions using ModernBERT with 8192-token context support!
### Model Details
- **Model Name**: [lettucedect-large-modernbert-en-v1]( KRLabsOrg/lettucedect-large-modernbert-en-v1)
- **Organization**: [KRLabsOrg](https://huggingface.co/KRLabsOrg)
- **Github**: [https://github.com/KRLabsOrg/LettuceDetect](https://github.com/KRLabsOrg/LettuceDetect)
- **Architecture**: ModernBERT (Large) with extended context support up to 8192 tokens
- **Task**: Token Classification / Hallucination Detection
- **Training Dataset**: [RagTruth]( wandb/RAGTruth-processed)
- **Language**: English
- **Capabilities**: Detects hallucinated spans in answers, provides confidence scores, and calculates average confidence across detected spans.
LettuceDetect excels at processing long documents to determine if an answer aligns with the provided context, making it a powerful tool for ensuring factual accuracy.
terryyz
authored
a
paper
12 days ago
Post
2483
Check out [DeepSeek-R1 INT2 model(
OPEA/DeepSeek-R1-int2-mixed-sym-inc). This 200GB DeepSeek-R1 model shows only about a 2% drop in MMLU, though it's quite slow due to kernel issue.
| | BF16 | INT2-mixed |
| ------------- | ------ | ---------- |
| mmlu | 0.8514 | 0.8302 |
| hellaswag | 0.6935 | 0.6657 |
| winogrande | 0.7932 | 0.7940 |
| arc_challenge | 0.6212 | 0.6084 |
| | BF16 | INT2-mixed |
| ------------- | ------ | ---------- |
| mmlu | 0.8514 | 0.8302 |
| hellaswag | 0.6935 | 0.6657 |
| winogrande | 0.7932 | 0.7940 |
| arc_challenge | 0.6212 | 0.6084 |
JustinLin610
authored
a
paper
16 days ago
bluelike
authored
a
paper
16 days ago
KnutJaegersberg
posted
an
update
22 days ago
Post
1125
Designing Ecosystems of Intelligence from First Principles
(new major Friston paper)
https://arxiv.org/abs/2212.01354
(new major Friston paper)
https://arxiv.org/abs/2212.01354
SivilTaram
authored
a
paper
23 days ago
yuchenlin
authored
a
paper
24 days ago