X-Git-Url: https://git.librecmc.org/?a=blobdiff_plain;f=TODO;h=9349189b36b9fe2b5846be6c858b50bab0e63b17;hb=a42b4e0ed22b65631caea4bb456f3d8fc21f11b1;hp=aa8ba525cc3e031655488b5b3a30025ec6ce6d0f;hpb=2202873156947fd5f1b634347b580fe13b24f2c5;p=oweals%2Fgnunet.git diff --git a/TODO b/TODO index aa8ba525c..9349189b3 100644 --- a/TODO +++ b/TODO @@ -1,166 +1,111 @@ -0.9.0pre1: -* FS: [CG] - - test indexing - - test migration - - TTL/priority calculations - - hot-path routing, load considerations - - statistics - - active reply route caching design & implementation of service; gap extension! - - Indexing: -May 16 12:49:50 fs-13737 WARNING `open' failed on file `/home/grothoff/svn/gnunet/src/fs/H/' at disk.c:1253 with error: No such file or directory -May 16 12:49:50 fs-13737 WARNING Could not access indexed file `ENUTBMBR' at offset 2064384: No such file or directory - NOTE: corrupted filename in open message - NOTE: odd directory name in open message - -==14995== 8 bytes in 1 blocks are definitely lost in loss record 1 of 12 -==14995== at 0x4024C4C: malloc (vg_replace_malloc.c:195) -==14995== by 0x4068F05: GNUNET_xmalloc_unchecked_ (common_allocation.c:92) -==14995== by 0x4068E33: GNUNET_xmalloc_ (common_allocation.c:61) -==14995== by 0x40519F5: GNUNET_DATASTORE_get_random (datastore_api.c:1102) -==14995== by 0x804ADCF: gather_migration_blocks (gnunet-service-fs.c:969) -==14995== by 0x40864C8: run_ready (scheduler.c:514) -==14995== by 0x4086970: GNUNET_SCHEDULER_run (scheduler.c:642) -==14995== by 0x408CF1B: GNUNET_SERVICE_run (service.c:1404) -==14995== by 0x804F725: main (gnunet-service-fs.c:3506) -==14995== -==14995== 8 bytes in 1 blocks are definitely lost in loss record 2 of 12 -==14995== at 0x4024C4C: malloc (vg_replace_malloc.c:195) -==14995== by 0x4068F05: GNUNET_xmalloc_unchecked_ (common_allocation.c:92) -==14995== by 0x4068E33: GNUNET_xmalloc_ (common_allocation.c:61) -==14995== by 0x4051ACB: GNUNET_DATASTORE_get (datastore_api.c:1160) -==14995== by 0x804F39A: handle_start_search (gnunet-service-fs.c:3352) -==14995== by 0x4087F9A: GNUNET_SERVER_inject (server.c:653) -==14995== by 0x40880A8: process_client_buffer (server.c:714) -==14995== by 0x4088529: restart_processing (server.c:848) -==14995== by 0x40864C8: run_ready (scheduler.c:514) -==14995== by 0x4086970: GNUNET_SCHEDULER_run (scheduler.c:642) -==14995== by 0x408CF1B: GNUNET_SERVICE_run (service.c:1404) -==14995== by 0x804F725: main (gnunet-service-fs.c:3506) -==14995== -==14995== 120 bytes in 15 blocks are definitely lost in loss record 5 of 12 -==14995== at 0x4024C4C: malloc (vg_replace_malloc.c:195) -==14995== by 0x4068F05: GNUNET_xmalloc_unchecked_ (common_allocation.c:92) -==14995== by 0x4068E33: GNUNET_xmalloc_ (common_allocation.c:61) -==14995== by 0x4050DA1: GNUNET_DATASTORE_put (datastore_api.c:695) -==14995== by 0x804DD79: handle_p2p_put (gnunet-service-fs.c:2591) -==14995== by 0x40588B8: main_notify_handler (core_api.c:468) -==14995== by 0x4067DAE: receive_task (client.c:499) -==14995== by 0x40864C8: run_ready (scheduler.c:514) -==14995== by 0x4086970: GNUNET_SCHEDULER_run (scheduler.c:642) -==14995== by 0x408CF1B: GNUNET_SERVICE_run (service.c:1404) -==14995== by 0x804F725: main (gnunet-service-fs.c:3506) -==14995== +0.9.0pre2: +* BLOCK: + - implement FS plugin + - design new block-lib API + - move FS serivce to new block API +* FS: + - integrate with DHT + - measure latencies (core, datastore) => trust economy + - refuse content migration message (or solicit?) + - FS performance benchmarking +* DHT: + - use new block lib +* CORE: + - derived key generation [Nils] + - Jun 27 11:51:54 core-7670 ERROR Assertion failed at gnunet-service-core.c:3616. + (transport notified us that we connected to ourselves!!!) + - transport-level disconnect (i.e. TCP) does not cause core-level + disconnect in a timely fashion (waits for connection timeout); + need to figure a way to make it near-instant in those cases + (i.e. rapid reduction in timeout on transport-level disconnect) [CG] + => may have been fixed with instant-notification of disconnect + to core on session-oriented connection hick-up; not perfect but + likely good enough until we get ATS going; still should be tested... + => "peers connected (transport)" now instantly goes to ZERO (core statistic), + but "established sessions" stays up... -* TBENCH: [MW] - - good to have for transport/DV evaluation! -* DV: [Nate] - - write DV API (need to move declarations from dv_api.c to gnunet_dv_service.h!) - - implement DV service - - implement DV library (looks done) - - implement DV transport plugin - - implement testcases - - implement performance tests (needs tbench) -* TOPOLOGY: +0.9.0pre3: +* Determine RC bugs and fix those (release should have no known real bugs) +* DATASTORE: [LT] + - GNUNET_DATASTORE_cancel method not tested [LT] +* TESTING: [Nate] + - test basic peer re-configure +* TOPOLOGY: [Nate] - needs more testing (especially F2F topology) & transport blacklisting -* UTIL: - - only connect() sockets that are ready (select()) [Nils] - [On W32, we need to select after calling socket before doing connect etc.] - - add support for UNIX domain sockets [CG] -* GNUNET-GTK: - - use g_main_context_set_poll_func to integrate GTK with GNUnet Scheduler!? (YUCK!) - - OR: add scheduler API to enable integration with GTK main loop instead of doing our own select - - use g_main_context_pending, g_main_context_query / g_main_context_check / g_main_context_dispatch - and NEVER g_main_loop_run (can this be done? might be the clean way to do this! But how - to integrate this with "gtk_main"? Docu says: - "It's OK to use the GLib main loop directly instead of gtk_main(), though it involves - slightly more typing. See GMainLoop in the GLib documentation." - => so maybe it "just works"? -* SETUP: - - design & implement new setup tool - -0.9.0pre2: -* TRACEKIT: [MW] - - good to have for DV/DHT evaluation! -* DHT: [Nate] - - implement DHT service - - implement testcases - - implement performance tests -* TRANSPORT: - - HTTP backend [MW] -* ARM: [Safey] - - better crash management (attach debugging support, capture and analyze - debug output, detect random vs. deterministic crashes) - - discover dependencies between services - => need UNIX domain sockets first! - - handle gnunet-arm -k in combination with auto-start magic (what is the right thing here?) +* TRANSPORT-TCP [MW]: + - should use hash map to look up sessions +* NAT/UPNP: [Milan] + - finalize API design + - code clean up + - testing + - integration with transport service + - also do UPnP-based (external) IP detection + (Note: build library always, build UPnP service when dependencies like libxml2 are available) * FS: [CG] - - datastore reservation (publishing) - - location URIs (publish, search, download) - - unindex on index failure - - utilize in-line files in meta data always (including in search results or - when download is triggered manually and for probes); currently the data is - only used when users do a general 'recursive' download + - library: + + reconstruct IBLOCKS from DBLOCKS if possible (during download; see FIXME in fs_download) + + add support for pushing "already seen" search results to FS service for bloomfilter + + use different 'priority' for probe downloads vs. normal downloads + - service: + + trust: do not charge when "idle" / load considerations (migration, routing) + + artificial delays + + active reply route caching design & implementation; gap extension! - non-anonymous FS service (needs DHT) + DHT integration for search + CS-DHT-functions (DHT-put of LOC) + P2P-functions (DHT-get) - - collection API & tests - + gnunet-pseudonym (collection support) - implement FS performance tests + insert + download + search + unindex -* MIGRATION: - - improved content selection (not just 'get_random') - -0.9.0pre3: -* Determine RC bugs and fix those! -* TESTING: [Nate] - - modify configuration to allow controlling connections for non-local starts - - testbed creation with topology (needs working F2F topology) - - testbed with churn - - implement testcases for distributed testing - - test basic peer re-configure - - test topology creation - - test churn generation - - consider changing API for peer-group termination to - call continuation when done -* NAT/UPNP: [MW] - - finalize API design - - code clean up - - testing - - integration with transport service -* MYSQL database backends: [CG] - - datacache - - datastore -* FS: - - reconstruct IBLOCKS from DBLOCKS if possible (during download; see FIXME in fs_download) - - add support for pushing "already seen" search results to FS service for bloomfilter (can wait) - - use different 'priority' for probe downloads vs. normal downloads -* ARM: + - re-implement gnunet-auto-share +* GNUNET-GTK: + - optimize meta-data for directories in 'add_dir_at_iter' + - finish publish dialog details: + + normalize keywords (edit subdialog) + + set/view previews (edit subdialog) + - implement download by URI dialog; figure out where to display those downloads! + - figure out where in the GUI we should show active uploads/unindex operations and allow aborts + - implement unindex operation (use dialog with all indexed files for selection) + - events: + + search error + + publish error + + unindex error +* ARM: [CG/Safey] - better tracking of which config changes actually need to cause process restarts by ARM. + - handle gnunet-arm -k in combination with auto-start magic (what is the right thing here?) + - discover dependencies between services +* MONKEY: [Safey] + - better crash management (attach debugging support, capture and analyze + debug output, detect random vs. deterministic crashes) + - '-m EMAIL' option for alternative e-mail TO + - '-f FILENAME' option to write report to file instead of e-mail (for testing!) 0.9.0: -* new webpage: - - expand bibliography +* Determine RC bugs and fix those (release should have no known real bugs) +* UTIL: + - only connect() sockets that are ready (select()) [Nils] + [On W32, we need to select after calling socket before doing connect etc.] +* new webpage: [BL] - convert documentation pages to books - update books (especially for developers) - - create good Drupal theme for GNUnet - make a NICE download page and figure out how to enable developers to publish TGZs nicely - port "contact" page - - add content type for "todo" items? -* POSTGRES database backends: [CG] - - datacache - - datastore -* Determine RC bugs and fix those! + - add content type for "todo" items +* SETUP: [CG] + - design & implement new setup tool +* TBENCH: [MW] + - good to have for transport/DV evaluation! +* TRACEKIT: [MW] + - good to have for DHT evaluation! +* DHT: [Nate] + - performance tests -0.9.x: +0.9.1: * TRANSPORT: [MW] - - SMTP transport backend - - HTTPS transport backend - + improved HTTPS support in MHD - + actual plugin + - WiFi transport backend [DB] + - implement gnunet-transport (transport configurator / tester) - Implement method of learning our external addresses from other peers; need some kind of threshold-based scheme, limiting both the total number of addresses that we accept @@ -176,44 +121,70 @@ May 16 12:49:50 fs-13737 WARNING Could not access indexed file `ENUTBMBR' at off a way to easily "veto" addresses off the list! => If MiM attacker uses vetoed address, blacklist the specific IP for the presumed neighbour! - - implement gnunet-transport (transport configurator / tester) - - UPnP-based IP detection - (Note: build library always, build service when libxml2/etc. are available) -* FS: [CG] - - Remove KBlocks in gnunet-unindex (see discussion with Kenneth Almquist on gnunet-devs in 9/2009) -* PEERINFO: [CG] - - expire 'ancient' HELLOs (those without valid addresses AND that - we have not 'used' (for their public keys) in a while; need a way - to track actual 'use') - - make sue we also trigger notifications whenever HELLOs expire -* VPN - - - -Optimizations: -* TCP: - - should use hash map to look up sessions -* STATISTICS: - - should use BIO instead of mmap -* TRANSPORT: - need to periodically probe latency/transport cost changes & possibly switch transport - should use hash map to look up Neighbours (service AND plugins!) -* DATASTORE (?): - - check for duplicates on insertion (currently, same content is frequently - stored again [seen with KBLOCKS and SBLOCKS]!) -* PEERINFO: +* DV: [Nate] + - proper bandwidth allocation + - performance tests +* PEERINFO: - merge multiple HELLOs of the same peer in the transmission queue (theoretically reduces overhead; bounds message queue size) - merge multiple iteration requests over "all" peers in the queue (theoretically reduces overhead; bounds messgae queue size) -* FS: - - use different queue prioritization for probe-downloads vs. normal downloads (!?) +* STATISTICS: [CG] + - should use BIO instead of mmap +* FS: [CG] + - Remove KBlocks in gnunet-unindex (see discussion with Kenneth Almquist on gnunet-devs in 9/2009) + - use different queue prioritization for probe-downloads vs. normal downloads +* UTIL: [CG] + - allow limiting UNIX socket access by UID/GID +* GNUNET-GTK: [CG] + - add tool bar + - do meaningful update to status line (starting up, peer running, #connections, shutdown, ...) + - add progress dialog for 'add_dir_at_iter' scan (can take a while...) + - NS list in search dialog should use colors to offset our own namespaces from the others + - right-clicking on NS list in search dialog should open menu that allows + * viewing full meta data + * deletion of namespace info -Minor features: +0.9.2: +* PEERINFO: [NN] + - expire 'ancient' HELLOs (those without valid addresses AND that + we have not 'used' (for their public keys) in a while; need a way + to track actual 'use') + - make sue we also trigger notifications whenever HELLOs expire * TCP: - repeatedly resolve hostname and look up interfaces to determine our own IP - [./transport/plugin_transport_tcp.c:391]: (style) struct or union member 'Plugin::address_update_task' is never used (related to issue above) * TRANSPORT: - [./transport/gnunet-service-transport.c:173]: (style) struct or union member 'TransportPlugin::rebuild' is never used (related to TCP not refreshing external addresses?) + - WiFi transport backend + * nice signal strength adjustment [MW] + * energy cost in ATS [MW] * BLOCKS: - - testcase would be nice... + - testcase would be nice + - generic block support for DHT +* STATISTICS: + - test notification-based statistics API [LT] + - implement statistics GUI (=> start from gnunet-gtk by button!) +* PEERINFO: [NN] + - move peerinfo to new GUI (=> start from gnunet-gtk by button!) + - extend peer dialog with green-yellow-red connectivity status lights + - extend peer dialog with country flags and names + +0.9.3: +* SMTP transport backend: + - sending (SMTP/SMTPS) + - receiving (IMAP/IMAPS/POP?) + - rate limiting + - improved batching + - resource limit integration with ATS +* VPN [PT] + - DNS hijacking + - DNS exit + - TCP entry/exit + - UDP entry/exit + - internal services + - integration with DHT routing + - optimized routes (beyond DHT/DV) + - "DNS" .gnunet