-
Notifications
You must be signed in to change notification settings - Fork 217
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
John Kerl
committed
Oct 14, 2018
1 parent
4a7f44d
commit d3dbfb7
Showing
2 changed files
with
68 additions
and
47 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,71 +1,90 @@ | ||
# Title goes here | ||
# New data-cleaning features, limited localtime support, and bugfixes | ||
|
||
## Features: | ||
|
||
* [**altkv**](http://johnkerl.org/miller/doc/reference-verbs.html#altkv) resolves https://github.com/johnkerl/miller/issues/184 which was originally opened via an email request. | ||
email request ... | ||
|
||
* clean-whitespace et al. | ||
https://github.com/johnkerl/miller/issues/190 | ||
* The new [**clean-whitespace**](http://johnkerl.org/miller/doc/reference-verbs.html#clean-whitespace) verb resolves | ||
https://github.com/johnkerl/miller/issues/190 from @aborruso. | ||
Along with the new functions | ||
[**strip**](http://johnkerl.org/miller/doc/reference-dsl.html#strip), | ||
[**lstrip**](http://johnkerl.org/miller/doc/reference-dsl.html#lstrip), | ||
[**rstrip**](http://johnkerl.org/miller/doc/reference-dsl.html#rstrip), | ||
[**collapse_whitespace**](http://johnkerl.org/miller/doc/reference-dsl.html#collapse_whitespace), and | ||
[**clean_whitespace**](http://johnkerl.org/miller/doc/reference-dsl.html#clean_whitespace), there is | ||
coarser-grained and finer-grained control over whitespace within field names and/or values. | ||
See the linked-to documentation for examples. | ||
|
||
* The new [**altkv**](http://johnkerl.org/miller/doc/reference-verbs.html#altkv) verb resolves | ||
https://github.com/johnkerl/miller/issues/184 which was originally opened via an email request. This supports mapping | ||
value-lists such as `a,b,c,d` to alternating key-value pairs such as `a=b,c=d`. | ||
|
||
* The new [**fill-down**](http://johnkerl.org/miller/doc/reference-verbs.html#fill-down) verb resolves | ||
https://github.com/johnkerl/miller/issues/189 | ||
by | ||
@aborruso | ||
See the linked-to documentation for examples. | ||
|
||
* fill-down https://github.com/johnkerl/miller/issues/189 | ||
* uniq -a https://github.com/johnkerl/miller/issues/168 | ||
@aborruso | ||
* The [**uniq**](http://johnkerl.org/miller/doc/reference-verbs.html#verb) verb now has a **uniq -a** | ||
which resolves https://github.com/johnkerl/miller/issues/168 from @sjackman. | ||
|
||
* Localtime functions | ||
https://github.com/johnkerl/miller/issues/170 | ||
@sitaramc | ||
* strptime ... | ||
* strftime ... | ||
* strptime_local ... | ||
* strftime_local ... | ||
* sec2localtime | ||
* sec2localdate | ||
* localdate | ||
* localtime2sec | ||
|
||
* regextract and regextract_or_else | ||
* The new | ||
[**regextract**](http://johnkerl.org/miller/doc/reference-dsl.html#regextract) and | ||
[**regextract_or_else**](http://johnkerl.org/miller/doc/reference-dsl.html#regextract_or_else) | ||
functions resolve | ||
https://github.com/johnkerl/miller/issues/183 | ||
@aborruso | ||
by @aborruso. | ||
xxx. | ||
|
||
* ssub | ||
* The new [**ssub**](http://johnkerl.org/miller/doc/reference-dsl.html#ssub) function arises from | ||
https://github.com/johnkerl/miller/issues/171 | ||
ish @dohse | ||
|
||
* xxx mlr uniq -a, w/ issue number? | ||
https://github.com/johnkerl/miller/issues/168 | ||
@sjackman | ||
by @dohse, as a simplified way to avoid escaping characters which are special to regular-expression parsers. | ||
|
||
* There are [**localtime**] functions in response to | ||
https://github.com/johnkerl/miller/issues/170 by @sitaramc, as follows. However note that | ||
as discussed on https://github.com/johnkerl/miller/issues/170 these do not undo one another in all | ||
circumstances. | ||
This is a non-issue for timezones which do not do DST. Otherwise, please use with disclaimers. | ||
* [**localdate**](http://johnkerl.org/miller/doc/reference-dsl.html#localdate) | ||
* [**localtime2sec**](http://johnkerl.org/miller/doc/reference-dsl.html#localtime2sec) | ||
* [**sec2localdate**](http://johnkerl.org/miller/doc/reference-dsl.html#sec2localdate) | ||
* [**sec2localtime**](http://johnkerl.org/miller/doc/reference-dsl.html#sec2localtime) | ||
* [**strftime_local**](http://johnkerl.org/miller/doc/reference-dsl.html#strftime_local) | ||
* [**strptime_local**](http://johnkerl.org/miller/doc/reference-dsl.html#strptime_local) | ||
|
||
## Builds: | ||
|
||
* appveyor artifacts | ||
https://github.com/johnkerl/miller/issues/167 | ||
https://github.com/johnkerl/miller/issues/148 | ||
https://github.com/johnkerl/miller/issues/109 | ||
* Windows build-artifacts are now available in Appveyor at | ||
https://ci.appveyor.com/project/johnkerl/miller/build/artifacts, and will be attached to this and future releases. This | ||
reseolvs https://github.com/johnkerl/miller/issues/167, https://github.com/johnkerl/miller/issues/148, and | ||
https://github.com/johnkerl/miller/issues/109. | ||
|
||
* travis osx in addition to linux | ||
* Travis builds at https://travis-ci.org/johnkerl/miller/builds now run on OSX as well as Linux. | ||
|
||
* An Ubuntu 17 build issue was fixed by @singalen on https://github.com/johnkerl/miller/issues/164. | ||
|
||
## Documentation: | ||
|
||
* put/filter documentation was confusing: https://github.com/johnkerl/miller/issues/169 | ||
* rectangularize joins after unpaired https://github.com/johnkerl/miller/issues/193 http://johnkerl.org/miller-releases/miller-head/doc/faq.html#How_to_rectangularize_after_joins_with_unpaired? | ||
* <tt>put</tt>/<tt>filter</tt> documentation was confusing as reported by @NikosAlexandris on | ||
https://github.com/johnkerl/miller/issues/169. | ||
|
||
faqent +<a id="How_to_rectangularize_after_joins_with_unpaired?"/><h1>How to rectangularize after joins with unpaired?</h1> | ||
* The new FAQ entry | ||
http://johnkerl.org/miller-releases/miller-head/doc/faq.html#How_to_rectangularize_after_joins_with_unpaired? | ||
resolves | ||
https://github.com/johnkerl/miller/issues/193 | ||
by @aborruso. | ||
|
||
cookbook +<a id="Options_for_dealing_with_duplicate_rows"/><h1>Options for dealing with duplicate rows</h1> | ||
* The new cookbook entry | ||
http://johnkerl.org/miller/doc/cookbook.html#Options_for_dealing_with_duplicate_rows arises from | ||
https://github.com/johnkerl/miller/issues/168 from @sjackman. | ||
|
||
mapper_put_or_filter_usage doc bug ... | ||
* The <tt>unsparsify</tt> documentation had some words missing as reported by | ||
@tst2005 on https://github.com/johnkerl/miller/issues/194. | ||
|
||
* unsparsify doc bug https://github.com/johnkerl/miller/issues/194 | ||
* There was a typo in the cookpage page http://johnkerl.org/miller/doc/cookbook.html#Full_field_renames_and_reassigns | ||
as fixed by @tst2005 in https://github.com/johnkerl/miller/pull/192. | ||
|
||
## Bugfixes: | ||
|
||
* Escape dollar sign in regular expressions https://github.com/johnkerl/miller/issues/171 | ||
* Memory usage and large files https://github.com/johnkerl/miller/issues/181 | ||
|
||
## Other: | ||
|
||
* https://github.com/johnkerl/miller/issues/164 @singalen ubuntu 17 build issue | ||
* There was a memory leak for TSV-format files only as reported by @treynr on https://github.com/johnkerl/miller/issues/181. | ||
|
||
@icumu | ||
* Dollar sign in regular expressions were not being escaped properly as reported by @dohse on | ||
https://github.com/johnkerl/miller/issues/171. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters