Commit Graph

  • 276a110e90 Fixed bug in API key comparison CalDescent 2021-11-14 19:55:58 +00:00
  • b761674b2c Default temp path moved to a subfolder of the data path CalDescent 2021-11-14 17:00:49 +00:00
  • 0b20bf0145 Website serving now requires authentication for everything except the "domain map" server CalDescent 2021-11-14 16:00:58 +00:00
  • 1397cbeac2 General API key / security-related updates CalDescent 2021-11-14 15:59:08 +00:00
  • 06e122f303 Added 'localAuthBypassEnabled' setting to allow users to opt in to the old method of local authentication at their own risk. CalDescent 2021-11-14 15:24:15 +00:00
  • f062acfd7c Rework of API keys CalDescent 2021-11-14 15:14:37 +00:00
  • 97ca414fc0 Revert "Added "apiKeyDisabled" setting to bypass API key / loopback checking for those who need it." CalDescent 2021-11-13 19:19:54 +00:00
  • a9af5bcec4 Website serving code moved to a new class called ArbitraryDataRenderer CalDescent 2021-11-13 19:09:35 +00:00
  • 7e30bf4197 Fixed website preview functionality which isn't compatible with asynchronous building. CalDescent 2021-11-13 17:40:09 +00:00
  • c724ea9f69 Removed various /arbitrary API endpoints that were only really useful at the start of the data storage project. CalDescent 2021-11-13 17:11:40 +00:00
  • e6cc4a1180 Improved logging for times when data requests are rate limited. CalDescent 2021-11-13 16:59:39 +00:00
  • 3cce097b9d When a newer PUT exists for a resource, delete records of peers holding earlier transactions CalDescent 2021-11-13 16:58:23 +00:00
  • 53f9d6869d Improved logging when a resource has no identifier CalDescent 2021-11-13 16:52:02 +00:00
  • 61beee0f49 Tidied up unfinished arbitrary data payments code. CalDescent 2021-11-13 15:00:52 +00:00
  • 1f3d400ad6 Small refactor of previous commit's code to improve consistency. CalDescent 2021-11-13 13:47:29 +00:00
  • f2ff2187d9 Case sensitivity preference can now be specified when checking if an item is in a list. CalDescent 2021-11-13 13:37:16 +00:00
  • 28ddc0055f Implemented reader cache clearing CalDescent 2021-11-13 13:35:40 +00:00
  • 90b5b6bd8b Don't allow data to be fetched for viewing if the name is in the local blacklist. CalDescent 2021-11-13 12:54:14 +00:00
  • 53466797a5 Once we receive a file from a peer, add the mapping to the lookup table. CalDescent 2021-11-13 12:50:26 +00:00
  • f5235938b7 Rate limit any file list broadcasts CalDescent 2021-11-13 12:26:27 +00:00
  • 054860b38d Rework of storage policy handling, as the previous implementation didn't handle viewed data properly. CalDescent 2021-11-13 11:35:29 +00:00
  • b60d02b8f4 Fixed preexisting list name issue when blocking chat transactions by address CalDescent 2021-11-13 11:13:19 +00:00
  • 0d69797851 Block chat transactions on the local node if its sender owns a name that is blacklisted by the user. CalDescent 2021-11-13 11:12:52 +00:00
  • bfffff0750 /lists APIs now made fully generic CalDescent 2021-11-13 11:00:01 +00:00
  • b7bcd8da7d Prevent arbitrary data transactions being created unless the network supports it (i.e. the hard fork has taken place). CalDescent 2021-11-13 10:29:01 +00:00
  • d3862c97ba Added "APP" and "METADATA" service types CalDescent 2021-11-13 10:06:53 +00:00
  • c069c39ce1 Implemented automatic PUT/PATCH detection CalDescent 2021-11-13 09:56:13 +00:00
  • e994d501b0 Fixed errors in documentation CalDescent 2021-11-12 18:22:10 +00:00
  • caf163f98c Include "tempDataPath" in test settings so that tests don't put files in the main temp directory. CalDescent 2021-11-12 17:46:48 +00:00
  • 1c408db907 Rework of arbitrary APIs and qdata to support identifiers CalDescent 2021-11-12 17:42:21 +00:00
  • 8d44e07c32 Fixes issues relating to reading resources containing a single file CalDescent 2021-11-12 17:37:33 +00:00
  • d99fae4340 Added support for single file patching CalDescent 2021-11-12 17:37:02 +00:00
  • d49caa29ce Pass Service enum to TransactionRepository.getSignaturesMatchingCriteria() instead of an Integer. CalDescent 2021-11-12 14:22:22 +00:00
  • 8bebe11b4e Allow single files to be uploaded without compression CalDescent 2021-11-12 13:44:28 +00:00
  • 236a456cae Added support for single file uploads. CalDescent 2021-11-12 13:35:50 +00:00
  • 7bc745fa8e Added "THUMBNAIL" and "PLAYLIST" service types, and fixed a duplicate issue in earlier commit. CalDescent 2021-11-12 09:02:44 +00:00
  • 056fc8fbaf Treat a blank identifier as null CalDescent 2021-11-12 08:59:43 +00:00
  • b6aa507b41 Added "AUDIO" and "BLOG" service types. CalDescent 2021-11-11 09:16:16 +00:00
  • 4b1a5a5e14 Connected the rest of the system up to the recently added "identifier" feature. CalDescent 2021-11-11 09:12:54 +00:00
  • a364206159 Added "IMAGE", "VIDEO" and "DOCUMENT" service types. CalDescent 2021-11-07 18:44:05 +00:00
  • b5feb5f733 Fixed test which was failing due to an earlier commit CalDescent 2021-11-07 18:41:52 +00:00
  • 991125034e Added "identifier" property to arbitrary transactions CalDescent 2021-11-07 18:39:43 +00:00
  • a0fe1a85f1 Removed website publishing API since we now do everything using POST /arbitrary/{service}/{name} CalDescent 2021-11-07 18:23:14 +00:00
  • 3a2e68c334 Improved directory structure of the "reader" cache CalDescent 2021-11-07 17:16:42 +00:00
  • b6418cd912 Revert "Added an index to help speed up recent queries" CalDescent 2021-11-06 12:52:20 +00:00
  • e652038018 Added an index to help speed up recent queries CalDescent 2021-11-06 12:47:32 +00:00
  • b2e2af51ed Added API endpoint to list all arbitrary resources, grouped by name and service CalDescent 2021-11-06 10:41:30 +00:00
  • 9502444bbc Prevent any kind of trading unless the blockchain is fully synced CalDescent 2021-11-05 16:31:54 +00:00
  • a0fe803c35 Added POST /arbitrary/{service}/{name} API endpoint CalDescent 2021-11-05 14:46:22 +00:00
  • ea2ca37abe Improved format of error messages CalDescent 2021-11-05 14:38:10 +00:00
  • 0601ffbb34 Added /transactions/convert method to use to convert full transaction bytes to ones used for signing CalDescent 2021-11-05 14:37:47 +00:00
  • 09a7fcaba4 Added MissingDataException CalDescent 2021-11-04 09:09:54 +00:00
  • ce15784851 Return a detailed error message in GET /arbitrary/{service}/{name} CalDescent 2021-11-03 21:55:55 +00:00
  • b861b2dffb Fixed loading bug when a transaction's data size is smaller than the chunk size. CalDescent 2021-11-03 21:54:57 +00:00
  • e50fd786da Don't respond with a file list for a transaction that is outside of our storage policy, even if we do have a copy of the file at the time of the request. CalDescent 2021-11-03 21:44:31 +00:00
  • 5e82de667e Don't broadcast that we are holding files for a transaction unless it's within the scope of our storage policy. CalDescent 2021-11-03 21:40:15 +00:00
  • d7ddcda9da Refactor to simplify some duplicated code CalDescent 2021-11-03 21:39:02 +00:00
  • 6d031130b9 Invalidate the cache in ArbitraryTransaction.onImportAsUnconfirmed() if we have the local data CalDescent 2021-11-03 21:33:29 +00:00
  • a61b0685f0 Arbitrary data manager now only prefetches data according to the storage policy. CalDescent 2021-11-03 20:24:38 +00:00
  • abfeafc823 Refactored to move all build-related code to a new ArbitraryDataBuildManager class CalDescent 2021-11-03 19:56:52 +00:00
  • 3a51be3430 ArbitraryDataBuildManager renamed to ArbitraryDataBuilderThread, as we will likely want to run multiple instances of this when we scale up. CalDescent 2021-11-03 19:38:17 +00:00
  • 3b914d4a7f Improved trade bot backups so that the current order being bought is included. CalDescent 2021-11-03 19:27:56 +00:00
  • ede4802ceb Converted ArbitraryTestTransaction to version 5 CalDescent 2021-11-03 19:19:27 +00:00
  • fe79119809 Added PresenceTestTransaction, to allow SerializationTests.testTransactions() to be unblocked CalDescent 2021-11-03 19:18:26 +00:00
  • 319d96f94e Add CWD bootstrap node Scare Crowe 2021-11-03 11:45:47 +05:00
  • 6f07dc7852 Always overwrite existing data when building via the queue. CalDescent 2021-11-02 19:34:25 +00:00
  • 16bcba6e2e When accessing a website or other data resource, request the chunks if we don't already have them. CalDescent 2021-11-02 19:32:48 +00:00
  • 1002acb021 Fixed error in log entry. CalDescent 2021-11-02 09:15:55 +00:00
  • b771544c5d Added test to check website/data updates. CalDescent 2021-11-02 09:09:54 +00:00
  • 8c7f09c454 Fixed yet another case sensitivity issue. CalDescent 2021-11-01 20:02:38 +00:00
  • 618cffefb1 Made names case insensitive when using them as a search filter. CalDescent 2021-11-01 19:44:43 +00:00
  • 8fd37e857e Fixed case sensitivity issue when building from past transactions. CalDescent 2021-11-01 19:41:50 +00:00
  • 8218bfd24b Initial implementation of storage policies. CalDescent 2021-10-31 22:38:30 +00:00
  • cbb2dbffb9 The /arbitrary/search API endpoint now uses a string instead of an int for the "service", and shows a dropdown of possible values in the API documentation page. CalDescent 2021-10-31 21:22:51 +00:00
  • 528a838643 Fixed bug in previous commit CalDescent 2021-10-31 21:20:59 +00:00
  • cbed6418e7 Added ability to filter arbitrary transactions by name when searching. CalDescent 2021-10-31 21:07:14 +00:00
  • 4882cc92a8 StoragePolicy enum moved to new ArbitraryDataStorageManager class CalDescent 2021-10-31 20:32:32 +00:00
  • 28fb11068e Added "storagePolicy" setting, including startup validation. CalDescent 2021-10-31 19:15:26 +00:00
  • 394ced9fb9 "Lists" feature is now generic. CalDescent 2021-10-31 18:39:58 +00:00
  • 90465149e6 Added API endpoints to allow registered names to be followed/unfollowed. CalDescent 2021-10-31 18:42:18 +00:00
  • c6d868d981 "Lists" feature is now generic. CalDescent 2021-10-31 18:39:58 +00:00
  • bada4fd140 Use a buffered digest where possible instead of reading the whole file contents into memory. CalDescent 2021-10-30 18:21:06 +01:00
  • 60f96d15bd When specifying a domain without a subdomain, add a www. version automatically. CalDescent 2021-10-30 17:47:57 +01:00
  • 0328007345 Domain mapping now uses registered name instead of transaction signature. CalDescent 2021-10-30 17:29:23 +01:00
  • 3ad0e92a0f Log empty responses in qdata CalDescent 2021-10-29 18:58:59 +01:00
  • 3934120541 Return the data directly in GET /arbitrary/{service}/{name}, instead of a path to the data CalDescent 2021-10-29 18:52:05 +01:00
  • 24ca126f5a Various qdata improvements CalDescent 2021-10-29 17:58:47 +01:00
  • 651ca71126 Added transaction validity log. CalDescent 2021-10-29 17:50:03 +01:00
  • e7cb33d8e2 Synchronize peer data lookups. CalDescent 2021-10-29 17:46:58 +01:00
  • c63d238316 Log the error response in the qdata utility if broadcasting a transaction fails. CalDescent 2021-10-29 17:26:40 +01:00
  • dcdc48d917 Private key moved from command line argument to QORTAL_PRIVKEY env variable, to improve security. CalDescent 2021-10-29 17:24:22 +01:00
  • f4c1671079 Removed the need to include public key in recently added API endpoints, as it can be derived from the registered name's owner. CalDescent 2021-10-29 17:08:26 +01:00
  • 7aa2fbee1c Added "qdata" command line tool to host and retrieve data CalDescent 2021-10-29 16:51:41 +01:00
  • f1939fdc2b Added generic PUT, PATCH, and GET /arbitrary API endpoints CalDescent 2021-10-29 16:45:08 +01:00
  • c9356d0ff5 Re-broadcast the arbitrary signatures message if it contains new data, so that the message finds its way to all online peers. CalDescent 2021-10-29 16:16:58 +01:00
  • 6b5d938a40 Added saveChanges() missing from previous commit, and a discardChanges() just in case. CalDescent 2021-10-29 16:16:05 +01:00
  • d82da160f3 Added DHT-style lookup table to track file locations CalDescent 2021-10-29 13:35:17 +01:00
  • 54c8aac20d Commented out unused forwarding code CalDescent 2021-10-29 13:27:37 +01:00
  • 314b6fc2f8 Include the initial peers when creating bootstraps CalDescent 2021-10-27 08:46:52 +01:00
  • 974df031a0 Added another bootstrap host CalDescent 2021-10-26 21:41:22 +01:00