{"action":"created","issue":{"url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/621","labels_url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/621/labels{/name}","comments_url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/621/comments","events_url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/621/events","html_url":"https://github.com/fsharp/FSharp.Data/issues/621","id":32931398,"number":621,"title":"CSVProvider failing on rich UTF8 files?","user":{"login":"Rickasaurus","id":1429,"avatar_url":"https://avatars.githubusercontent.com/u/1429?v=3","gravatar_id":"","url":"https://api.github.com/users/Rickasaurus","html_url":"https://github.com/Rickasaurus","followers_url":"https://api.github.com/users/Rickasaurus/followers","following_url":"https://api.github.com/users/Rickasaurus/following{/other_user}","gists_url":"https://api.github.com/users/Rickasaurus/gists{/gist_id}","starred_url":"https://api.github.com/users/Rickasaurus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rickasaurus/subscriptions","organizations_url":"https://api.github.com/users/Rickasaurus/orgs","repos_url":"https://api.github.com/users/Rickasaurus/repos","events_url":"https://api.github.com/users/Rickasaurus/events{/privacy}","received_events_url":"https://api.github.com/users/Rickasaurus/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/fsharp/FSharp.Data/labels/type-bug","name":"type-bug","color":"6E0069"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":12,"created_at":"2014-05-06T20:48:26Z","updated_at":"2015-03-21T13:13:55Z","closed_at":"2015-03-21T13:13:55Z","body":"I'm seeing some rather odd behavior, and it doesn't seem to matter which flags I use.  I tried it like this:\r\n\r\n```fsharp\r\ntype extNamesType = CsvProvider<extNamesFile, HasHeaders = false, Separators = \"\\t_\">\r\n```\r\n\r\nand I get error:\r\n\r\nSystem.Exception: Couldn't parse row 429511 according to schema: Expected 5 columns, got 6\r\n   at <StartupCode$FSharp-Data>.$CsvRuntime.data@189-1.Invoke(String message) in C:\\Git\\FSharp.Data SourceLink\\src\\Csv\\CsvRuntime.fs:line 189\r\n   at Microsoft.FSharp.Core.PrintfImpl.go@523-3[b,c,d](String fmt, Int32 len, FSharpFunc`2 outputChar, FSharpFunc`2 outa, b os, FSharpFunc`2 finalize, FSharpList`1 args, Int32 i)\r\n   at Microsoft.FSharp.Core.PrintfImpl.run@521[b,c,d](FSharpFunc`2 initialize, String fmt, Int32 len, FSharpList`1 args)\r\n   at <StartupCode$FSharp-Core>.$Reflect.Invoke@720-4.Invoke(T1 inp)\r\n   at <StartupCode$FSharp-Data>.$CsvRuntime.data@184.GenerateNext(IEnumerable`1& next) in C:\\Git\\FSharp.Data SourceLink\\src\\Csv\\CsvRuntime.fs:line 188\r\n   at Microsoft.FSharp.Core.CompilerServices.GeneratedSequenceBase`1.MoveNextImpl()\r\n   at Microsoft.FSharp.Collections.SeqModule.oneStepTo@1219[T](IEnumerable`1 source, List`1 prefix, FSharpRef`1 enumeratorR, Int32 i)\r\n   at Microsoft.FSharp.Collections.SeqModule.f@4244-2[T](IEnumerable`1 source, List`1 prefix, FSharpRef`1 enumeratorR, Int32 i, Unit unitVar0)\r\n   at Microsoft.FSharp.Collections.SeqModule.result@1235.Invoke(Int32 i)\r\n   at Microsoft.FSharp.Collections.IEnumerator.unfold@190.DoMoveNext(b& )\r\n   at Microsoft.FSharp.Collections.IEnumerator.MapEnumerator`1.System-Collections-IEnumerator-MoveNext()\r\n   at FSI_0037.extNames@24-9.GenerateNext(IEnumerable`1& next) in J:\\Basis\\DJ vs DJ Extended Unicode\\DJETL\\DJETL\\LoadAndGraph.fsx:line 24\r\n   at Microsoft.FSharp.Core.CompilerServices.GeneratedSequenceBase`1.MoveNextImpl()\r\n   at System.Collections.Generic.HashSet`1.UnionWith(IEnumerable`1 other)\r\n   at System.Collections.Generic.HashSet`1..ctor(IEnumerable`1 collection, IEqualityComparer`1 comparer)\r\n   at <StartupCode$FSI_0037>.$FSI_0037.main@() in J:\\Basis\\DJ vs DJ Extended Unicode\\DJETL\\DJETL\\LoadAndGraph.fsx:line 22\r\nStopped due to error\r\n\r\nOddly, I manually investigated that line and those around it, here was no extra tab or underline.  So I tried:\r\n\r\n```fsharp\r\ntype extNamesType = CsvProvider<extNamesFile, HasHeaders = false, Separators = \"\\t_\", IgnoreErrors = true>\r\n```\r\n\r\nand it only took 648,902 lines of the file.  The actual number of rows in the file is 2,317,134.  I have another smaller file (975,488 lines) I wrote using the same procedure and didn't get any errors.  Any idea what might be going wrong? "},"comment":{"url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/comments/84332908","html_url":"https://github.com/fsharp/FSharp.Data/issues/621#issuecomment-84332908","issue_url":"https://api.github.com/repos/fsharp/FSharp.Data/issues/621","id":84332908,"user":{"login":"ovatsus","id":738761,"avatar_url":"https://avatars.githubusercontent.com/u/738761?v=3","gravatar_id":"","url":"https://api.github.com/users/ovatsus","html_url":"https://github.com/ovatsus","followers_url":"https://api.github.com/users/ovatsus/followers","following_url":"https://api.github.com/users/ovatsus/following{/other_user}","gists_url":"https://api.github.com/users/ovatsus/gists{/gist_id}","starred_url":"https://api.github.com/users/ovatsus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ovatsus/subscriptions","organizations_url":"https://api.github.com/users/ovatsus/orgs","repos_url":"https://api.github.com/users/ovatsus/repos","events_url":"https://api.github.com/users/ovatsus/events{/privacy}","received_events_url":"https://api.github.com/users/ovatsus/received_events","type":"User","site_admin":false},"created_at":"2015-03-21T13:13:55Z","updated_at":"2015-03-21T13:13:55Z","body":"Closing until we get a repro"}}