Weekly Dev Update #35

Developer-Update-Pic-35

Hey Y’all,

Another weekly Dev Update for you to peruse.

Loki Core

The core team has begun streaming more frequently – you can catch Doy-lee streaming here: https://www.twitch.tv/doy_lee/


Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519https://www.twitch.tv/neuroscr

  • Master branch changes
  • Staging branch changes (gets posted to master when stable)
    • More DHT tests (PR259)
    • Import abseil LTS 20181200 to provide various backports of C++17 to C++11 (PR267)
    • Fix random.snode not working on macos (PR271)
    • Set dns flags to not advertise recursion on nxdomain (PR273)
    • Move DNS AA header flag from AAAA record type to all (PR274)
    • Disable A records for random.snode, use CNAME queries instead (PR275)
    • Hook MX records for all types of virtual TLDs (PR276)
    • Lower UTP fragment by 512 bytes (PR278)
    • Build everything with -fPIC (PR280)
    • Fix macOS build (PR281)
    • Windows: Libabyss work, crash/unit test fixes, polling improvements (PR283)
    • Start of converting router into abstract base class (PR284)
    • Fix local ip ping, relax DHT timing, don’t send latency when building paths, allow multiple concurrent DHT lookups, make DNS not crash (PR285)
    • Refactor bits.hpp and add tests (PR286)
    • Fix windows build system (PR287)
    • Fix nodedb commits, prevent loop (PR288)
    • Add more params to testnet and update docs (PR289)
    • Re-enable ninja build option (again) (PR290)
    • Rename public-address to public-ip, fix testnet, INI parser fix (PR291)
    • Pick newest introset when multiple are available (PR292)
    • Fix unix build caused by PR292 (PR293)
    • Adjust Makefile, fix nodedb deadlock, prevent multiple introsets from being sent (PR294)
    • More DHT fixes, only return the most up to date when multiple options (PR295)
    • Changes can be found at:
      https://github.com/loki-project/loki-network/commits/staging
  • PR suggested changes (coming to staging soon)

Loki Messenger

Thanks,

Kee

Weekly Dev Update #34

Hey Y’all,

We’re back with another Dev Update for you all.

Loki Core

  • Infinite Staking refinement and squashing new bugs including
    • Adjusting contribution minimum rules to adhere to key image limits and reservation amounts
    • Improving prepare_registration UX
    • And many small regressions caught in integration tests

https://github.com/loki-project/loki/pull/406

  • New Infinite Staking integration tests being implemented:

https://github.com/Doy-lee/loki-integration-testing/commits/master


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519, https://www.twitch.tv/neuroscr


We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Master branch changes
  • Staging branch changes (gets posted to master when stable)
    • Sort out which llarp_buffers are copied and which are not (PR266)
    • Refix kqueue read/write order (PR265)
    • Various compiler fixes (PR268 & 269)
    • Fix buffer overrun in edge case (PR 264)
    • Downgrade DNS server failure to warning, autodetection delay and address issue 251 (PR255)
    • Don’t always configure automatically (PR254)
    • Add cluster-shell contrib (PR252, PR253)
    • localhost.loki DNS lookup support (PR 250)
    • Enable exit info (PR 249)
    • Crypto_interface refactor (PR248)
    • More DHT unit tests (PR247)
    • LibAbyss RPC update (PR245)
    • Changes can be found at:
      https://github.com/loki-project/loki-network/commits/staging

Loki Messenger

Thanks,  

Kee

Weekly Dev Update #33

Hey Y’all,

We’re back with another Dev Update, and starting our week on a Tuesday coz public holidays!

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Master branch changes
  • Staging branch changes (gets posted to master when stable)
    • Try to fix loading non-default connections from config (Issue 233)
    • Revert to use u instead of t for timestamp in RC for backwards compatible reasons
    • Update windows bootstrap downloader
    • Update gtest framework
    • Updated bootserv
    • Merge in UX improvements (PR 230)
    • Rebuild INI parser
    • More DHT tests (PR236)
    • Separate event loop/listeners implementations (PR237)
    • Tweak FD_SETSIZE to reduce the possibility of UDP timeouts
    • Lower non-AVX2 minimum CPU target to NetBust Xeon (Nocona, Prescott)
    • Start work on enabling hidden services on windows server clients
    • Changes can be found at: https://github.com/loki-project/loki-network/commits/staging
  • PR suggested changes (coming to staging soon)
    • PR250 – add initial localhost.loki handling in dns
    • PR249 – enable exit info serialization
    • PR248 – Convert llarp::Crypto into an abstract base class
    • PR247 – More unit tests of dht internals
    • PR245 – update libabyss rpc endpoints for Service Nodes
    • Changes can be found at https://github.com/loki-project/loki-network/pulls

Loki Messenger

Research work:

  • More algorithms have been tested regarding our public key to swarm id assignment. By changing the swarm id algorithm from using a uniform random number generator to a specific predetermined sequence that maximises uniformity, the Euclidean distance calculations now provides mapping with much better uniformity, while only affecting neighbours when a swarm is added or removed. (https://github.com/sachaaaaa/loki-swarm-pubkey-test)

Thanks,

Kee

Weekly Dev Update #32

Hey Y’all,

Another week, another update here at Loki.

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519, https://www.twitch.tv/neuroscr


We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Master branch changes
  • Staging branch changes
    • File reorganisation continues
    • Added more test for crypto/types
    • Attempt to fix LoadFromFile bug
    • Fix rare bad allocations by making sure we correctly insert into pendingEstablishedJobs before scheduling a on_try_connecting job
    • Add pidfile option
    • Openrc for FreeBSD
    • Changes can be found at:
      https://github.com/loki-project/loki-network/commits/staging
  • PR suggested changes
    • 230 UX Improvements
      • Logging changes design to help during remotely supporting/debugging Lokinet problems
        • Kqueue fix: fix read stomping write data
        • Bring back ShouldCreateDefaultHiddenService(), allows you to turn off default so you can be pure HS
        • Jeff approved workaround to read Keyfile early so Name() can be correct during set up/configuration
        • Make error messages more descriptive
        • Always show what config file it’s using
        • Declare it’s attempting to create config file
        • Make llarp_ev_add_tun smarter (“” ifnames/ifaddrs are treated as auto)
        • Make kqueue more verbose about tun failures (esp helpful on macos)
        • Handle identity-privkey better
        • A fair amount of clang-formatting
    • 236 Add test suites for dht bucket, kademlia and key
    • 237 Separate header and implementation
      • Finally separated the windows event loop/listener implementation from the original headers
    • Changes can be found at https://github.com/loki-project/loki-network/pulls

Loki Messenger

Research work:

  • Created new repository for simulating different algorithms for the “arbitrary public key” to swarm id assignment, which will be performed by the Service Nodes. So far, the simulations have confirmed that compared to a 1-dimensional Euclidean distance, the Hamming distance offers the best uniformity in the amount of public keys assigned to swarms, but this comes with a larger amount of swarms affected when a swarm is added or deleted. Please note that this is a work in progress. (https://github.com/sachaaaaa/loki-swarm-pubkey-test)

Thanks,  

Kee

Weekly Dev Update #31

Hey Y’all,

Most of the developers are back and kicking into gear this week, so much of the activity on the repositories will pick up pace.

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Master branch changes
    • Fix issues with random.snode resolution
    • Allow building a shared-library
    • Start kubernetes runtime wrapper
    • Fix FreeBSD build
    • Changes can be found at:
      https://github.com/loki-project/loki-network/
    • GitHub Pulse Stats for the last week: Excluding merges, 4 authors have pushed 17 commits to master and 40 commits to all branches. On master, 24 files have changed and there have been 343 additions and 84 deletions.
  • Staging branch changes
    • Linux/OSX platform build fixes
    • Enable shared library by default
    • Source code reorganisation continues
    • Fix MacOS tun name
    • Add a flag to generate coverage data (gcovr support)
    • Upgrade C++11 standard to C++14
    • Change docker debian:latest to debian:stable
    • More unit tests
    • Changes can be found at:
      https://github.com/loki-project/loki-network/commits/staging

Loki Messenger

Thanks,

Kee

Weekly Dev Update #30

Hi Everyone,

Most people are back from their Christmas holidays now, so expect the development updates to start filling up again with some of the cool stuff we have been working on.

Loki core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Progress continues on libllarp:
    • Lower non-AVX2 minimum CPU target to NetBurst Xeon (Nocona, Prescott)
  • Platform and packaging updates:
    • Make bootstrap not overwrite existing key on failure
    • Updated wget requirement to curl for better multiplatform support
    • Additional Android support work
    • Windows
      • Remove lossy write buffer from
      • Change socket set size to 96 sockets from 4k to speed things up and reduce timeouts
      • Hidden service and Service Node access is now working
      • Update Netscape CA cert bundle
  • Clean up continues:
    • Make sure session’s “upstream” is cleared after processing to avoid uninitialised memory
    • Make sure upstream and downstream clear functions clear all relay properties
    • Make sure the tuntap get ifname can’t buffer overrun
  • All changes can be found at https://github.com/loki-project/loki-network
  • Excluding merges, 3 authors have pushed 13 commits to master and 34 commits to all branches. On master, 40 files have changed and there have been 2,250 additions and 2,326 deletions.

Loki Messenger

Thanks,

Kee

Weekly Dev Update #29

Hey Y’all,

The first day of 2018! Smaller dev update this week since most of us were on holidays for the last week celebrating Christmas.


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519 , https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Progress continues on libllarp:
    • Add graceful stop for path builders
    • Don’t build paths if shutting down
    • Check if we need more paths 30s into the future
    • Rate limit pathbuilding a bit
    • Reduce allocations in messaging parsing
    • Keep exit paths alive based on traffic
    • Don’t kill exits when they are active
    • Only removed parsed message if successful in parsing
  • Platform and packaging updates:
    • make lokinet-win32 installer safe to use for in-place upgrades
    • Older windows machines will need to restart for the IPv6 support
    • RPI options renamed NON_PC_TARGET
  • Clean up continues:
    • Fix hash in TransitHopInfo
  • GitHub Pulse Stats for the last week: Excluding merges, 5 authors have pushed 56 commits to master and 56 commits to all branches. On master, 367 files have changed and there have been 7,642 additions and 4,427 deletions.
  • Changes can be found at:
    https://github.com/loki-project/loki-network/
  • Current version: v0.3.1
    https://github.com/loki-project/loki-network/releases/tag/v0.3.1

Thanks,

Kee

Weekly Dev Update #28

Hey Y’all,

Merry Christmas, and happy holidays to everyone! Over the next few weeks the Dev Updates will probably be more sparse as most of the team is having a little time off for the Christmas period. We hope to be refreshed before a great 2019 for Loki!

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519 , https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.


Loki Messenger

Thanks,

Kee

Weekly Dev Update #27

Hey Y’all,

Festive Freya and bulletproofs are now active, reducing the average transaction size by about 90% and fees by about 25 times!

Anyone who is having issues syncing past the hard fork height of 161849 should download the point release here for the CLI https://github.com/loki-project/loki/releases/tag/v2.0.2, and here for the GUI: https://github.com/loki-project/loki-gui/releases/tag/v2.0.2

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519, https://www.twitch.tv/neuroscr

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our Github repo. If you have a Github account, please consider helping us out.

  • Progress continues on libllarp:
    • Make sure debug doesn’t output binary
    • Update introset if no good paths
    • IntroSet responses clear updating flag
    • Fixed unhandled key ‘q’ issue for hidden services
    • Flush SN traffic queues
    • Random.snode hostname
    • Expire old SN sessions
  • Platform and packaging updates:
    • BSD: Pktinfo fixes
    • Windows: fix C++ atomics
    • Clean up CMakeLists
    • Improve cmake options documentation
    • Include lokinet-bootstrap in make install
    • Change unreliable OpenDNS defaults to CloudFlare
  • Clean up continues
    • Convert llarp_router, llarp_nodedb, and llarp_crypto to C++ class
    • Removed dead address_info code
    • Converted CoC to CONTRIBUTING
    • Move all headers into llarp/
    • Create .cpp placeholders for all .hpps
    • Make sure C headers don’t have C++
  • GitHub Pulse Stats for the last week: Excluding merges, 5 authors have pushed 56 commits to master and 56 commits to all branches. On master, 367 files have changed and there have been 7,642 additions and 4,427 deletions.
  • Changes can be found at: https://github.com/loki-project/loki-network/
  • Current version: v0.3.1 https://github.com/loki-project/loki-network/releases/tag/v0.3.1

Loki Messenger

Thanks,

Kee

Weekly Dev Update #26

Hey Y’all,

Another weekly Dev Update for everyone. We released Festive Freya Version 2.0.1 this week which fixed a number of subtle bugs that we introduced in 2.0.0. Both 2.0.0 and 2.0.1 are compatible with the Festive Freya hardfork, but we recommend you update if you experienced any issues with RPC or IP resolution.

Loki Core


LLARP / Lokinet

If you’re lucky and join our Discord, you might also catch Jeff or Ryan, the developers of LLARP, live streaming as they code: https://www.twitch.tv/uguu25519https://www.twitch.tv/neuroscr

We’d like to welcome Lilac to the community development team. She’s currently working on some potential iOS support.

We could really use your help. To be considered for inclusion in packaging distribution, we need people to star, watch and fork our github repo. If you have a github account, please consider helping us out.

  • Progress continues on libllarp
    • Rewrote DNS functions
    • Try to set_cap on install
    • Update man pages
    • Make sure all paths tics even expired
    • Disable locking on pathsets
    • Pull router out of pathbuilder, use context router
    • Build fixes for MacOS, RPI, Windows
    • Reaccelerate DNS responses if we already have a map/path
    • Re-add MX support
    • Prevent exits from communicating with bogons
    • Bootstrap shell script correctness
    • Convert llarp_logic to C++ class
    • Convert to use cmake install
    • Limiting on path building
    • Make sure exit router is known before flushing or ticking endpoint
    • Replace PubKey/SecretKey with RouterID
  • GitHub Pulse Stats for the last week: Excluding merges, 5 authors have pushed 34 commits to master and 34 commits to all branches. On master, 127 files have changed and there have been 18,437 additions and 1,122 deletions.
  • Changes can be found at:
    https://github.com/loki-project/loki-network/
  • Current version: v0.3.1
    https://github.com/loki-project/loki-network/releases/tag/v0.3.1

Loki Messenger

Thanks,

Kee