[jira] [Resolved] (HADOOP-7464) hadoop fs -stat '{glob}' gives null with combo of absolute and non-existent files

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Resolved] (HADOOP-7464) hadoop fs -stat '{glob}' gives null with combo of absolute and non-existent files

JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/HADOOP-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andras Bokor resolved HADOOP-7464.
----------------------------------
    Resolution: Duplicate

> hadoop fs -stat '{glob}' gives null with combo of absolute and non-existent files
> ---------------------------------------------------------------------------------
>
>                 Key: HADOOP-7464
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7464
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.20.2
>         Environment: CDH3u0
>            Reporter: Jay Hacker
>            Assignee: Andras Bokor
>            Priority: Minor
>
> I'm trying to {{hadoop fs -stat}} a list of HDFS files all at once, because doing them one at a time is slow.  stat doesn't accept multiple arguments, so I'm using a glob of the form '\{file1,file2\}' (quoted from the shell).  I've discovered this doesn't work for me because the glob expands non-existent files to nothing, and I get nothing back from stat.  It would be nice to be able to use stat for this, but perhaps that's more of a feature request.
> However, in the process, I discovered that with relative pathnames, I get back the stats for the existing files.  With absolute filenames, I get back {{stat: null}}.  
> $ hadoop fs -touchz file1 file2
> $ hadoop fs -stat '\{file1,file2\}'
> 2011-07-15 21:21:19
> 2011-07-15 21:21:19
> $ hadoop fs -stat '\{file1,file2,nonexistent\}'
> 2011-07-15 21:21:19
> 2011-07-15 21:21:19
> $ hadoop fs -stat '\{user/me/file1,/user/me/file2\}'
> 2011-07-15 21:21:19
> 2011-07-15 21:21:19
> $ hadoop fs -stat '\{/user/me/file1,/user/me/file2,nonexistent\}'
> stat: null
> Perhaps I'm doing something dumb, but it seems like stat should give the same results whether you use relative or absolute paths.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Loading...