Commit Graph

268 Commits (cab821f253976a21a1ad5fcf05d9d5fe3b3100c1)

Author SHA1 Message Date
erdgeist 9297967f85 Add a stat option the count bucket stalls
Add an iterator for all torrents. It's slower but for stats it's okay.
Move some stats collection stuff to the new iterator. More to come.
Start a "report all stats" page.
Start fixing the code to identify "busy" networks.
Add the concept of hosts allowed to proxy.
Add a parser for the X-Forwarded-For: HTTP header.
Clean up HTTP Header handling code. (Remove some left overs of now vanished sync code).
16 years ago
erdgeist 72a1564ca1 Value of off is not used, so don't calculate it 16 years ago
erdgeist ff3c0feab5 Add workaround to openbsd's broken v6 API 16 years ago
erdgeist 2d3718151d Fix a pointer arithmetic issue leading to incorrect peer data being copied. Allocate correct size for debugbuffer. Expect exact values on find keywords, not only prefix match. 16 years ago
erdgeist 0b875273d4 Remove debug message 16 years ago
erdgeist f12fa4c362 Use a self pipe to wake from io_wait when a thread finished his work. 16 years ago
erdgeist 66c906d5d3 Add comments, rename our struct http_data h to cookie, all clientsockets to sock, all size_t from socket_recvs to byte_count. Make signal handler set default handler for the second SIGINT 16 years ago
erdgeist 02b3abbab6 Make v4 and v6 modes v4/v6-ONLY 16 years ago
erdgeist 131211b4da V6 16 years ago
erdgeist 779d6c235f * http and udp routines now use thread local buffers passed in workstruct containers. In other words they do not use static_buffer anymore and are considered to be thread safe.
* the new workstruct also introduces a well defined buffer and result passing path
* a new function scan_find_keywords is a wrapper around scan_urlencoded_query that maps keys in url to values passed in an array of ot_keywords structs
* this new function cleans up much of url parameter parsing work, where read_ptr and write_ptr have been introduced rather than the confusing char *c, *data variables
* I now use memcmp instead of byte_diff to allow compiler to optimize constant size string compares
* got rid of UTORRENT_1600_WORKAROUND
* livesync_ticker is now only called from one (currently main) thread to avoid race conditions
16 years ago
erdgeist 8bdc0d73f6 Make opentracker ANSI C again. 16 years ago
erdgeist 2df09905f5 * opentracker now drops permissions in correct order and really chroots() if ran as root
* lock passing between add_peer_to_torrent and return_peers_for_torrent is now avoided by providing a more general add_peer_to_torrent_and_return_peers function that can be used with NULL parameters to not return any peers (in sync case)
* in order to keep a fast overview how many torrents opentracker maintains, every mutex_bucket_unlock operation expects an additional integer parameter that tells ot_mutex.c how many torrents have been added or removed. A function mutex_get_torrent_count has been introduced.
16 years ago
erdgeist 5c99e50e25 minoe white space 16 years ago
erdgeist c6947b160f Handle program end more politely 16 years ago
erdgeist ad8c9ee1ef Avoid cast warning on 64bit machines 16 years ago
erdgeist 08c7162783 Renamed OT_FLAG to OT_PEERFLAG to make code easier to read
Introduced READ16/32 and WRITE16/32 makros to abstract loading/storing from unaligned addresses away on cpu's that can actually load/store everywhere
Removed all unnecessary memmoves, especially where it only moved 6 bytes in inner loop. I replaced them with WRITE16/32(READ16/32()) makros
16 years ago
erdgeist 334c6e4bbb The BIG refactoring [tm]. Too many changes to count them. If it doesn't suite you, revert to last version. 16 years ago
erdgeist daaee855b2 Whitespace fixes 16 years ago
erdgeist 529919ac83 Fix: blacklist and whitelist config option parsing code was the wrong way 16 years ago
erdgeist 06b503a11f Enable stats restricting config file option 16 years ago
erdgeist f4283be677 Fix debug output for addresses >127 16 years ago
erdgeist fae73214af A new config file option to connect to tcp and udp at once has been added. Also some clarifications have been put into the sample config file. 16 years ago
erdgeist bca01f4cde document the new config file feature. 16 years ago
erdgeist 17724dde29 Make ot_try_bind local again. Also dont handle multi cast udp packets in opentracker.c, ot_livesync.c does it by itself. 16 years ago
erdgeist 68b1b8409b Make scan_ip4_port API more sane, add debug output, be less tolerant when syntax checking command line options 16 years ago
erdgeist e534db03c6 added live sync code
added a config file parser
added tracker id
changed WANT_CLOSED_TRACKER and WANT_BLACKLIST into WANT_ACCESS_WHITE and WANT_ACCESS_BLACK
changed WANT_TRACKER_SYNC to WANT_SYNC_BATCH and added WANT_SYNC_LIVE
added an option to switch off fullscrapes

cleaned up many internal hardcoded values, like PROTO_FLAG,
16 years ago
denis b637fdcdf3 add missing include on linux 16 years ago
erdgeist 408c5f98ed Introducing live busy network detection. 17 years ago
erdgeist c28cf398fd Introduce some kind of versioning 17 years ago
erdgeist bee364a6f3 / can now be redirected to any URL 17 years ago
denis 362a0e052a [19:19] <eRdgEiSt> Denis: erdgeist ist ein Volltrottel! 17 years ago
erdgeist 828831bbb6 Dont need arpa/inet 17 years ago
erdgeist fd41161407 Finally split up the opentracker.c cruft into ot_http.c, ot_accesslist.c and just leave in socket handling and parameter parsing 17 years ago
denis 0a1cc18358 add scrape stats and small correction to udp stats 17 years ago
erdgeist ae1863f232 Encforce setting the clock more often. This hopefully fixes a rare bug of g_now not being updated anymore. 17 years ago
erdgeist 09a662dfce Missed the second strnstr... fixed. 17 years ago
erdgeist 54560fdcd3 strnstr is not part of what posix conform libc has to offer... replace it by strstr after cutting off the last byte 17 years ago
erdgeist b1c8723609 Introducing compression for fullscrapes and tpbs stats 17 years ago
erdgeist e65ac51a28 Last user of sendmmapdata is gone. Purge it. 17 years ago
erdgeist cf8d4fae1d Sockets do not inherit non-blocking state in libowfat... 17 years ago
erdgeist 49ba269b9d Cleanup now moved to its own thread, too 17 years ago
erdgeist 8d5f221785 Full scrapes are now being delivered in different modes, as triggered by stats&mode=tpbs 17 years ago
erdgeist 6458a37d82 introducing multithreaded full scrape creation. 17 years ago
erdgeist e476006019 Move dead socket handling from handle_(read,write,timedout) into its own function handle_dead 17 years ago
erdgeist 697e239027 Moving accesslist stuff to its own object 17 years ago
erdgeist a8993b8eea Moving full scrapes to iovec-creating thread safe function 17 years ago
erdgeist 927ac023ce The expensive DMEM stats is gone. No need for it, too much potential to DOS. 17 years ago
erdgeist 41120f6a0d Move stats out of opentracker.c, also have an own file handle udp requests. 17 years ago
erdgeist 8900cc0dd9 No one can get access to buckets now without locking them. Also split up the trackerlogic.c-monster in functional sub-units. HEADS UP: this code is untested and not considered stable. 17 years ago
erdgeist a859ae78e5 Cleaned up stats return format. Also reflect APPI changes due to MT code in trackerlogic.{c,h} 17 years ago
erdgeist 8acc0ff48f Introduce configuration dependent number of parameters in a nicer way 17 years ago
erdgeist 5aa41e9d82 The last experiment failed. No more accept deferral 17 years ago
erdgeist d276addb7a Trying to accept connections only when data has come in. This is an experiment. 17 years ago
erdgeist 853dc33be2 Allow for more than one admin ip address 17 years ago
erdgeist dc8e889797 Add more full scrape stats 17 years ago
erdgeist 31eada6168 Reenabled syncing 17 years ago
erdgeist b19bbd6a85 Number of buckets is 1024 now
Clean all torrents now only cleans one bucket at a time
All torrents that are being worked upon in an announce are being cleaned on demoand
torrent's peer lists now keep extra counts for seeds and peers to speed up scrape and announce
Sync has gone for now. I will think up a new way to implement. The old one was way to slow.
17 years ago
erdgeist ab9246618b some clients chose to accidently send negative numwants 17 years ago
erdgeist 1fce733ea0 Accept clients that forget to spell announce at all... 17 years ago
erdgeist 69c6e2bc99 This uTorrent/1600 client requires some... measures :/ I dont like the workaround. 17 years ago
erdgeist ac57c3d5d6 Now measure the time a clean_all_torrents takes 17 years ago
erdgeist 6876e16242 assume anything looking like GET /a to be an announce... 17 years ago
erdgeist 3aa286d9b8 Last fix was not enough to get rid off those 1600er buggers. 17 years ago
erdgeist 00972c6c68 Work around the stupid utorrent 1600 bug. That'll be removed after a while. 17 years ago
erdgeist 0de8b53fdd Now the Holzhammer: GET /an is announce, GET /sc is scrape. Period. 17 years ago
erdgeist 6b2307015f now accept more classes of announce fuckups 17 years ago
erdgeist 42210450f3 Just one more typo 17 years ago
erdgeist 2cbb480865 Just one more typo 17 years ago
erdgeist 886421d2d5 Work around more typos that might end up in torrent files as announce urls 17 years ago
erdgeist 2b715b89f1 Debug code sometimes copied too much data 17 years ago
erdgeist ddd85ec7e0 Fixed one leak from struct_http 17 years ago
erdgeist 8098adb48e Be even more stupidistas-tolerant 17 years ago
erdgeist 84f8738b82 Fix debug output 17 years ago
erdgeist d768bf6e81 Enable _DEBUG_HTTPERROR to avoid warning... 17 years ago
erdgeist 53bce09735 Include time since startup in full scrape debug output 17 years ago
erdgeist c59e44ba94 Now limit full scrape to requests sending exactly "GET /scrape HTTP/" 17 years ago
erdgeist 41019c79d8 Introducing multiscrape 17 years ago
erdgeist d5876ebb6b Prevent url-decoding for debug by using a temp buffer 17 years ago
erdgeist 271ff156ec Those stupid "announce ?info_hash" torrents get really annoying. Fix it in announce and scrape. 17 years ago
erdgeist 1b0859411e be more verbose about what full scrape consumers deliver in their http requests 17 years ago
erdgeist 714ea1b88e give opentracker the missing header file 17 years ago
erdgeist f56e40c24e Must not dealloc mmaped buffers with free() 17 years ago
erdgeist d25cf9307e Fix misunderstandig of what libowfat thinks are seconds and what I did... 17 years ago
erdgeist e1f122f7d1 Since array and io_batch are in a union, and we also have time-outing writable sockets, we need to mark, which of the union is used. Also remove the blessed flag from struct http, since its rarely used and can be done in a seperate memcmp. 17 years ago
erdgeist 6eb441d8a0 Cannot access members after they are freed :/ 17 years ago
erdgeist b86e6382a1 Save a lot of work when skipping through uninteresting http request parameters 17 years ago
erdgeist 32f17413fa Increase send timeout. Also use an own variable for that. 17 years ago
erdgeist 28de135098 io_timeout is absolute, not relative :/ 17 years ago
erdgeist d1c57d90dd Free iobatches on timeout 17 years ago
erdgeist 8e78ac7012 HEADS UP: you need to check out the latest libowfat! Huge allocations are now taken from mmap()ed regions, not from heap anymore 17 years ago
erdgeist 1e6b48cbc0 Sockets we write to now do also timeout 17 years ago
erdgeist 28d88e3380 Exclude empty torrents from full scrape, also try to shrink full scrape buffer after it is full 17 years ago
erdgeist 3dc470d672 fixed line breaks in log 17 years ago
erdgeist 65cc45f129 Log all expansive operations to stderr 17 years ago
erdgeist ffffd80719 Most open trackers do not have the problem of not being called often enough.. so do not introduce an extra timeout when waiting for activity. That also removes one of the last extraneous gettimeofday calls 17 years ago
erdgeist 6c1adb8fc8 since gettimeofday is rather expansive, we do only fetch time once in a 5 second period, when we are delivered a SIGALRM. 17 years ago
erdgeist 4c15dc7a70 make 64bit safe 17 years ago
denis 0d36a8754e fixed some stat output 17 years ago
erdgeist c350fa0b3c New stats for s24s code, this is debug, do not use in real world 17 years ago
erdgeist 33c9c530d0 An announce with event=stopped now returns correct number of leechers and seeders. In TCP and UDP. 17 years ago