Frederic Branchaud-Charron's picture

3 5 11

Frederic Branchaud-Charron

Dref360

·

https://dref360.github.io/

Dref360

AI & ML interests

Bayesian deep learning, uncertainty estimation, and trustworthiness.

Recent Activity

upvoted a paper about 2 months ago

ViTPose++: Vision Transformer for Generic Body Pose Estimation

reacted to m-ric's post with 🚀 about 2 months ago

Today we make the biggest release in smolagents so far: 𝘄𝗲 𝗲𝗻𝗮𝗯𝗹𝗲 𝘃𝗶𝘀𝗶𝗼𝗻 𝗺𝗼𝗱𝗲𝗹𝘀, 𝘄𝗵𝗶𝗰𝗵 𝗮𝗹𝗹𝗼𝘄𝘀 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗽𝗼𝘄𝗲𝗿𝗳𝘂𝗹 𝘄𝗲𝗯 𝗯𝗿𝗼𝘄𝘀𝗶𝗻𝗴 𝗮𝗴𝗲𝗻𝘁𝘀! 🥳 Our agents can now casually open up a web browser, and navigate on it by scrolling, clicking elements on the webpage, going back, just like a user would. The demo below shows Claude-3.5-Sonnet browsing GitHub for task: "Find how many commits the author of the current top trending repo did over last year." Hi @mlabonne ! Go try it out, it's the most cracked agentic stuff I've seen in a while 🤯 (well, along with OpenAI's Operator who beat us by one day) For more detail, read our announcement blog 👉 https://huggingface.co/blog/smolagents-can-see The code for the web browser example is here 👉 https://github.com/huggingface/smolagents/blob/main/examples/vlm_web_browser.py

reacted to merve's post with 🚀 about 2 months ago

smolagents can see 🔥 we just shipped vision support to smolagents 🤗 agentic computers FTW you can now: 💻 let the agent get images dynamically (e.g. agentic web browser) 📑 pass images at the init of the agent (e.g. chatting with documents, filling forms automatically etc) with few LoC change! 🤯 you can use transformers models locally (like Qwen2VL) OR plug-in your favorite multimodal inference provider (gpt-4o, antrophic & co) 🤠 read our blog http://hf.co/blog/smolagents-can-see

View all activity

Organizations

Dref360's activity

upvoted a paper about 2 months ago

ViTPose++: Vision Transformer for Generic Body Pose Estimation

Paper • 2212.04246 • Published Dec 7, 2022 • 1

upvoted a paper 3 months ago

Apollo: An Exploration of Video Understanding in Large Multimodal Models

Paper • 2412.10360 • Published Dec 13, 2024 • 142

upvoted a collection 3 months ago

InternVL2.5

Better than InternVL 2.0 • 19 items • Updated 19 days ago • 89

upvoted a paper 7 months ago

Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

Paper • 2408.02442 • Published Aug 5, 2024 • 21

upvoted a paper about 1 year ago

ViewFusion: Towards Multi-View Consistency via Interpolated Denoising

Paper • 2402.18842 • Published Feb 29, 2024 • 15