1
0
mirror of https://github.com/minio/mc.git synced 2025-11-10 13:42:32 +03:00
Commit Graph

52 Commits

Author SHA1 Message Date
Praveen raj Mani
418c8e7182 Remove empty parent directories while mirroring fs (#2849)
Fixes 2826
2019-08-14 09:26:57 -07:00
Harshavardhana
e978c71b7c Add staticcheck based builds (#2788)
Additionally this PR also supports
multi-platform builds to avoid cross
platform build issues.
2019-06-03 11:22:31 -07:00
Harshavardhana
f4bb0b8850 Update minio-go to latest release v6.0.26 (#2782) 2019-05-29 08:27:18 -07:00
ebozduman
83a9d8b91d Adds missing codebase MinIO and min.io changes (#2745) 2019-04-16 22:31:54 -07:00
Harshavardhana
ba92305de0 Migrate to go1.12, deprecate vendor directory (#2727) 2019-03-27 10:08:19 -07:00
poornas
0490231b34 For non-canned policies, show policy status as custom (#2716) 2019-03-19 09:11:16 +05:30
poornas
5b585c4759 Additional flags for mc sql command (#2687)
add sql select options
change flag names and remove parquet option
add csv-output-header option
2019-03-11 22:23:45 -07:00
Ashish Kumar Sinha
2e612b23d6 Add metadata in mc copy (#2671)
Example : mc cp --attr key1=value1,key2=value2 
play/mybucket/burningman2011/ ~/latest/
2019-03-11 12:47:28 +05:30
poornas
e538599e2f Add mc rb command to remove empty bucket (#2662)
Change mc rm --recursive behavior to
delete objects in bucket but not the
bucket itself.

Fixes #2635
2019-02-16 20:12:38 -08:00
Praveen raj Mani
30965763d6 Support setting of custom policies from a JSON file (#2649)
Fixes #2633
2019-01-28 13:30:31 -08:00
Harshavardhana
59ef9fe468 Support SSE without keys (#2626) 2019-01-04 11:56:43 -08:00
Praveen raj Mani
4e7eeb0725 Ignore broken symlink durring mirror (#2607)
Fixes #2604
2018-12-21 13:38:12 -08:00
Harshavardhana
2073642656 Allow copying file onto itself (#2617)
This allows encrypting an unencrypted file
using server side CopyObject API.
2018-12-06 10:18:16 -08:00
Harshavardhana
0992c3a50d Fallback detecting filetype from magic numbers (#2598) 2018-11-16 07:45:46 -08:00
Kale Blankenship
8137e79d0c Close readers returned by Client.Get (#2595)
Change Client.Get to return an io.ReadCloser instead of io.Reader
so that it can be closed.
2018-11-08 17:02:14 -08:00
Harshavardhana
a83ffe321c Implement select command (#2538) 2018-09-30 23:18:33 -07:00
Harshavardhana
4070902cda Allow creating directories from S3 to filesystem (#2471)
Fixes #2460
2018-06-20 17:47:26 -07:00
poornas
0ede95b65e add encrypt option to cp, mirror,pipe,stat, cat and rm commands (#2400) 2018-03-08 17:18:41 +05:30
Harshavardhana
dfffc1e7cc mirror: Deprecate --force instead add --overwrite (#2318)
Fixes #2317
2017-11-30 16:51:17 +05:30
poornas
b3fe40e113 fix: append XAttr to metadata only if metadata requested (#2310) 2017-11-23 16:35:17 +05:30
poornas
ab6b2a83ac Add new stat sub command (#2275) 2017-10-31 13:56:40 -07:00
poornas
a86080a0b7 Add context in Put api call for cp/mirror. (#2291) 2017-10-20 13:50:35 -07:00
poornas
224e602e59 Allow multipart threads to be configured via environment variable (#2254) 2017-10-02 19:45:08 -07:00
Aditya Manthramurthy
ca96cfc6e6 Move pkg/probe from vendor dir to package dir (#2236)
The probe package is no longer available in the Minio server
repo. This change just moves probe from the vendor directory to its
own dir under `pkg`.

This is a maintenance fix.
2017-08-14 11:13:38 -07:00
Harshavardhana
5c135d25d6 mc: Vendorize minio-go this brings in streaming support. (#2203)
This PR brings following changes

- Brings streaming support for mc uploads.
- Brings support for copying objects upto 5TiB
  as a consequence of ComposeObject implementation
  in minio-go.
2017-07-06 20:41:34 +01:00
A. Elleuch
1b9beadf2b cat: Ignore Stat() error and pass to Get() (#2166)
* client: Avoid returning metadata with Get()

client-s3.Get() calls Stat() method because Get() is supposed to return
object metadata. This PR makes a change in client interface so metadata
is returned in Stat() method. This is beneficial for us to avoid calling
HEAD method in S3 when run `mc cat`

* cat: Ignore Stat() returned error

In case of cache gateway, HEAD objects returns 404 even though
objects are gettable. This PR ignores Stat() error since its
purpose in case of cat is to check if the download object size
is equal to what the server announced.
2017-07-04 08:13:57 -07:00
Harshavardhana
be3370396a Remove client instance being sent back in eventInfo() (#2167) 2017-06-05 07:44:22 -07:00
Harshavardhana
7f65ad4957 Add UTCNow() helper function (#2155)
This patch adds UTCNow() function which returns current UTC time.

This is equivalent of UTCNow() == time.Now().UTC()

Refer https://github.com/minio/minio/pull/3931
2017-05-16 18:50:54 +02:00
Harshavardhana
f0ccc91890 fs: Allow copying to special files if possible. (#2146)
Fixes #2145
2017-05-03 11:21:02 -07:00
Anis Elleuch
e54962e17f mb: Add -p flag to ignore existing bucket/dir (#2143)
If a remote directory/bucket exists, -p will still make mb cmd
happy if the target already exists.
2017-04-28 13:13:44 -07:00
Anis Elleuch
61e511cc3e fs watch: Use a dynamically sized channel (#2109)
Write a growing/shrinking channel to be able to absorb filesystem
notify events even when they come in large numbers.
2017-04-24 01:01:11 -07:00
Harshavardhana
9ea42680b0 watch/events: Add eventInfo struct for brevity. (#2120) 2017-04-11 09:08:04 -07:00
Harshavardhana
b0968e29e8 watch/events: Support events on Get/Head operations as well. (#2116)
Fixes #2073
2017-04-10 11:50:52 -07:00
Anis Elleuch
b1e3d147f5 ls: Fix listing incomplete entries result (#2081)
This also factors common code used by several types
of listing routines, by creating a filtering channel
of results returned by these channels.

e.g. Filter out incomplete uploads or vice versa
2017-03-21 10:34:43 -07:00
Anis Elleuch
6c89b81d7b fs: Remove handling of specific windows symlinks (#2080)
Go has fixed the problem of dealing with junction files
(https://github.com/golang/go/issues/9190). This commit
simplifies the code of client fs
2017-03-20 15:51:28 -07:00
Anis Elleuch
29920f8c9c fs stat(): Return dir stat with incomplete flag (#2078)
fs.Stat() returns an error when the path corresponds to
a directory and incomplete flag is enabled. This PR follows
S3 client behavior and fixes the behavior.
2017-03-20 11:06:43 -07:00
Harshavardhana
4425378b37 mc: Code cleanup after running gosimple tool (#2065) 2017-03-08 10:48:45 +01:00
Harshavardhana
d055f0edac fs: new files and folders created honors umask (#2023)
umask should be honored properly for all write
operations on filesystem. This is in line with
how all unix tools behave.

Fixes #2022
2017-02-19 22:41:56 +01:00
Anis Elleuch
9193eef1c9 clientfs: Fix policy mode calc. in GetAccess() (#1936)
Masking target directory file mode to be able to perform correct comparaison with policy standard file permissions in FS mode
2016-12-23 06:54:45 -08:00
Harshavardhana
782352ae56 mirror/cp/pipe: Preserve metadata while copying s3 to s3. (#1927)
Fixes #1923
2016-12-14 20:06:52 -08:00
Harshavardhana
f0d926ebba fs: Enhanced ignore list to do glob match. (#1910)
Fixes #1902
2016-12-05 14:07:18 -08:00
Harshavardhana
b51e6b0485 Fix downloading files with exact ranges requested in client FS. (#1892)
This is due to the fact that ReadAt() will not send io.EOF
when reading past the offset, server instead returns
Range error. Handle the error by only reading until the
requested size.
2016-11-21 02:53:24 -08:00
Harshavardhana
cf89d74561 Vendorize new minio-go code. (#1891)
This fixes #1889.

```sh
mc mirror -w
```

Now runs continous even when the source is not available.
Reconnects indefinitely in a binomially increasing fashion
and also allows jitter so that the retry has a nice
distribution as well.

This allows for 'mc mirror -w' to run continously without
further monitoring.
2016-11-20 16:31:53 -08:00
Anis Elleuch
2895b0acca Put() in client fs avoids reading from input reader when data is zero lengthy (#1879) 2016-11-08 16:59:23 -08:00
Anis Elleuch
b9f1950320 Use correct share upload url (#1863) 2016-10-25 13:23:22 -07:00
Bala FA
6de2b4559e Refactor rm command. (#1855)
This patch makes rm command to use minio-go.RemoveObjects() to removeobjects recursively.
2016-10-17 20:24:09 -07:00
Bala FA
75d55783c0 ls: fix incomplete listing for specific prefix (#1849)
Previously it was failing like below.

```
$ mc ls --incomplete myminio/mybucket
[2016-09-16 09:48:57 PDT] 576MiB 1.iso

$ mc ls --incomplete myminio/mybucket/1.iso
mc: <ERROR> Unable to initialize target ‘myminio/mybucket/1.iso’. Object key is missing, object key cannot be empty
```

This patch fixes this issue.
2016-10-04 17:19:05 -07:00
Anis Elleuch
2b24a7b520 Avoid seeking os.Stdin in client-fs Put() (#1834) 2016-09-25 10:19:13 -07:00
Anis Elleuch
8a48d604a8 Add policy list command (#1811) 2016-09-03 05:47:37 -07:00
Anis Elleuch
80b0aa3842 Fix inefficient assignments reported by ineffassign (#1817) 2016-09-02 12:31:52 -07:00