Skip to content

Instantly share code, notes, and snippets.

View szarnyasg's full-sized avatar

Gabor Szarnyas szarnyasg

235 followers · 36 following
View GitHub Profile
@szarnyasg
szarnyasg / duckdb.md
Created February 23, 2025 22:20
duckdb docs 2025-02-23
layout title github_repository redirect_from
docu
Swift Client
/docs/api/swift
/docs/api/swift/

DuckDB has a Swift client. See the [announcement post]({% post_url 2023-04-21-swift %}) for details.

@szarnyasg
szarnyasg / md5sums-v0.1.0.txt
Created July 10, 2023 13:44
DuckDB release hashes
13ff6bad97946ff1c972be0f92a5f9f2 v0.1.0.zip
@szarnyasg
szarnyasg / aws-ssd-persistence-test.md
Created January 1, 2022 08:25

AWS SSD persistence

i3

Run 1

sudo mkfs -t ext4 /dev/nvme0n1
sudo mkdir /data
sudo mount /dev/nvme0n1 /data
@szarnyasg
szarnyasg / duckdb-web-largest-files-committed.txt
Created December 4, 2021 16:53
This file has been truncated, but you can view the full file.
4d7714d39a65 56MiB _includes/benchmark_logs/83502611b96c4a3484e8b5ba1f533aa00bc5f067-stdout.json
49215cf6f862 51MiB _includes/benchmark_logs/26533d22eed3e0483138847e5243831294d26cac-stdout.json
ae94b72145d4 50MiB _includes/benchmark_logs/d97d84ea8c866ae8d95557f2a0be934a5c1ed94d-stdout.json
404b8d24f6d2 40MiB minibenchmarks.db
587a50766d05 40MiB minibenchmarks.db
5de500539c6f 39MiB minibenchmarks.db
165d6f3f6003 38MiB minibenchmarks.db
de7414fd4666 38MiB minibenchmarks.db
433b1a0b9166 38MiB minibenchmarks.db
@szarnyasg
szarnyasg / init-hadoop-standalone.sh
Created April 25, 2020 14:37
Hadoop configuration scripts
export HDFS_DIR=~/hadoopdata/hdfs
rm -rf $HDFS_DIR
mkdir -p $HDFS_DIR
# core-site.xml
sed -i "s|<configuration>|<configuration>\n <property><name>fs.default.name</name><value>hdfs://localhost:9000</value></property>|" etc/hadoop/core-site.xml
# hdfs-site.xml
@szarnyasg
szarnyasg / zstd-header-change.sh
Last active April 21, 2020 22:46
Save space for in-place sed with zstd
# compress $FILE with zstdmt
# remove $FILE
# print the header, decompress $FILE.zst afterwards and write them into $FILE
# delete $FILE.zst
FILE=myfile; zstdmt $FILE -f && rm $FILE && echo NEW_HEADER | cat - <(unzstd -c $FILE.zst | tail -n +2) > $FILE && rm $FILE.zst
@szarnyasg
szarnyasg / ldbc-datagen-sf1-updatestream-hadoop-2.9.2-vs-3.2.1.diff
Created November 17, 2019 20:06
See https://github.com/ldbc/ldbc_snb_datagen/pull/98
This file has been truncated, but you can view the full file.
--- social_network-2.9.2/updateStream_0_0_forum.csv 2019-11-17 20:16:18.681777592 +0100
+++ social_network-3.2.1/updateStream_0_0_forum.csv 2019-11-17 20:09:15.385415630 +0100
@@ -107,8 +107,8 @@
1347529389109|1346763085184|8|21990232558208|32985348841200|1347529389109
1347529393056|1264165549036|7|2199023411117|1347529393056|200.0.27.84|Firefox|About Marie Antoinette, throne upon the death of Louis XV in May 1774. After sAbout German Confederation, or|109|1274|71|2199023411105|-1|7564;11720
1347529395689|1325981965662|5|1511829541569|26388279069097|1347529395689
-1347529399109|1317839605970|5|2061584312047|21990232558208|1347529399109
1347529399109|1346763085184|5|1374389570680|32985348841200|1347529399109
+1347529399109|1317839605970|5|2061584312047|21990232558208|1347529399109
@szarnyasg
szarnyasg / social_network_activity_0_0.diff
Created October 1, 2019 17:39
LDBC Datagen Turtle serializers, 0.4.0 vs. 0.2.7 diffs
--- social_network/social_network_activity_0_0.ttl 2019-10-01 18:51:43.657741931 +0200
+++ /home/szarnyasg/ttl/social_network_activity_0_0.ttl 2019-10-01 18:02:32.224571989 +0200
@@ -48035228,52 +48035228,52 @@
sn:forum00000000687195815936 snvoc:hasTag <http://www.ldbc.eu/ldbc_socialnet/1.0/tag/Pretzel_Logic> .
sn:forum00000000687195815936 snvoc:hasTag <http://www.ldbc.eu/ldbc_socialnet/1.0/tag/Wooden_Leather> .
sn:forum00000000687195815936 snvoc:hasTag <http://www.ldbc.eu/ldbc_socialnet/1.0/tag/Ai_Sugiyama> .
-sn:forum00000000687195815936 snvoc:hasMember _:mbs00000000000003575029 .
-_:mbs00000000000003575029
+sn:forum00000000687195815936 snvoc:hasMember _:mbs00000000000001048576 .
+_:mbs00000000000001048576
@szarnyasg
szarnyasg / generating-and-compressing-weighted-and-unweighted-matrices.md
Last active August 31, 2019 07:04
Useful snippets for LDBC Graphalytics

Get the data sets

ls &&
    wget -i https://graphalytics.org/assets/datasets/xs.txt && \
    wget -i https://graphalytics.org/assets/datasets/s.txt && \
    wget -i https://graphalytics.org/assets/datasets/m.txt && \
    wget -i https://graphalytics.org/assets/datasets/l.txt && \
    wget -i https://graphalytics.org/assets/datasets/xl.txt && \
 wget -i https://graphalytics.org/assets/datasets/2xl.txt &amp;&amp; \
@szarnyasg
szarnyasg / MatrixMarket.jl-test.md
Created July 22, 2019 17:44 
[ Info: SparseArrays.SparseMatrixCSC{Complex{Float64},Int64}  (841, 841)
Test Summary:                                    | Pass  Total
read and write Harwell-Boeing_acoust_young1c.mtx |    1      1
[ Info: SparseArrays.SparseMatrixCSC{Complex{Float64},Int64}  (841, 841)
Test Summary:                                    | Pass  Total
read and write Harwell-Boeing_acoust_young2c.mtx |    1      1
[ Info: SparseArrays.SparseMatrixCSC{Complex{Float64},Int64}  (841, 841)
Test Summary:                                    | Pass  Total
read and write Harwell-Boeing_acoust_young3c.mtx |    1      1