{"action":"opened","issue":{"url":"https://api.github.com/repos/Parquet/parquet-mr/issues/448","labels_url":"https://api.github.com/repos/Parquet/parquet-mr/issues/448/labels{/name}","comments_url":"https://api.github.com/repos/Parquet/parquet-mr/issues/448/comments","events_url":"https://api.github.com/repos/Parquet/parquet-mr/issues/448/events","html_url":"https://github.com/Parquet/parquet-mr/issues/448","id":109064979,"number":448,"title":"ParquetLoader returns wrong fields when uses schema in constructor and pushProjection","user":{"login":"hershs","id":2777856,"avatar_url":"https://avatars.githubusercontent.com/u/2777856?v=3","gravatar_id":"","url":"https://api.github.com/users/hershs","html_url":"https://github.com/hershs","followers_url":"https://api.github.com/users/hershs/followers","following_url":"https://api.github.com/users/hershs/following{/other_user}","gists_url":"https://api.github.com/users/hershs/gists{/gist_id}","starred_url":"https://api.github.com/users/hershs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hershs/subscriptions","organizations_url":"https://api.github.com/users/hershs/orgs","repos_url":"https://api.github.com/users/hershs/repos","events_url":"https://api.github.com/users/hershs/events{/privacy}","received_events_url":"https://api.github.com/users/hershs/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-09-30T11:12:53Z","updated_at":"2015-09-30T11:12:53Z","closed_at":null,"body":"I have parquet file with one data row and schema (can't attach it, github don't support attachment of parquet files :( ).\r\n\r\neventid:long | timestamp:long | msisdn:chararray | amount:double | isactive:boolean\r\n------------ | ------------- | ------------- | ------------- | -------------\r\n10 | 1423828799999 | 10000 | 10.0 | false\r\n\r\nI use ParquetLoader with schema in constructor to prevent scanning all input files by the loader ( in real system the loader loads hundreds of files at ones). Then I want to filter out specific three columns.\r\n\r\nthe pig:\r\n```pig\r\nloaded = Load 'data.parquet' using ParquetLoader('eventid:long, timestamp:long, msisdn:chararray, amount:double, isactive:boolean');\r\n-- STORE loaded INTO 'loaded' using PigStorage();\r\nthreeFileds = FOREACH loaded GENERATE amount, eventid, timestamp;\r\nSTORE filteredStruct INTO 'threeFileds' using PigStorage();\r\n```\r\n\r\nin `threeFileds` I get wrong result:\r\n`10000\t10\t1423828799999`\r\ninstead of\r\n`10.0\t10\t1423828799999`\r\n\r\nIf the comment from the above script is been removed the result in `threeFileds` is good.\r\nSeems like that the `pushProjection` method in the frontend overrides inner schema with 3 fields, but in the backend it uses 5-fields schema from constructor.\r\n\r\nPlease advise.\r\n\r\nTested on version 1.5.0"}}