Convolutional versus Self Organized Operational Neural Networks for Real World Blind Image Denoising. Real world blind denoising poses a unique image restoration challenge due to the non deterministic nature of the underlying noise distribution. Prevalent discriminative networks trained on synthetic noise models have been shown to generalize poorly to real world noisy images. While curating real world noisy images and improving ground truth estimation procedures remain key points of interest, a potential research direction is to explore extensions to the widely used convolutional neuron model to enable better generalization with fewer data and lower network complexity, as opposed to simply using deeper Convolutional Neural Networks (CNNs). Operational Neural Networks (ONNs) and their recent variant, Self organized ONNs (Self ONNs), propose to embed enhanced non linearity into the neuron model and have been shown to outperform CNNs across a variety of regression tasks. However, all such comparisons have been made for compact networks and the efficacy of deploying operational layers as a drop in replacement for convolutional layers in contemporary deep architectures remains to be seen. In this work, we tackle the real world blind image denoising problem by employing, for the first time, a deep Self ONN. Extensive quantitative and qualitative evaluations spanning multiple metrics and four high resolution real world noisy image datasets against the state of the art deep CNN network, DnCNN, reveal that deep Self ONNs consistently achieve superior results with performance gains of up to 1.76dB in PSNR. Furthermore, Self ONNs with half and even quarter the number of layers that require only a fraction of computational resources as that of DnCNN can still achieve similar or better results compared to the state of the art.


Genesis of Polyatomic Molecules in Dark Clouds CO 2 Formation on Cold Amorphous Solid Water. Understanding the formation of molecules under conditions relevant to interstellar chemistry is fundamental to characterize the chemical evolution of the universe. Using reactive molecular dynamics simulations with model based or high quality potential energy surfaces provides a means to specifically and quantitatively probe individual reaction channels at a molecular level. The formation of CO 2 from collision of CO( 1 Sigma ) and O( 1 D) is characterized on amorphous solid water (ASW) under conditions typical in cold molecular clouds. Recombination takes place on the sub nanosecond time scale and internal energy redistribution leads to stabilization of the product with CO 2 remaining adsorbed on the ASW on extended time scales. Using a high level, reproducing kernel based potential energy surface for CO 2 , formation into and stabilization of CO 2 and COO is observed.


The iterated local transitivity model for hypergraphs. Complex networks are pervasive in the real world, capturing dyadic interactions between pairs of vertices, and a large corpus has emerged on their mining and modeling. However, many phenomena are comprised of polyadic interactions between more than two vertices. Such complex hypergraphs range from emails among groups of individuals, scholarly collaboration, or joint interactions of proteins in living cells. A key generative principle within social and other complex networks is transitivity, where friends of friends are more likely friends. The previously proposed Iterated Local Transitivity (ILT) model incorporated transitivity as an evolutionary mechanism. The ILT model provably satisfies many observed properties of social networks, such as densification, low average distances, and high clustering coefficients. We propose a new, generative model for complex hypergraphs based on transitivity, called the Iterated Local Transitivity Hypergraph (or ILTH) model. In ILTH, we iteratively apply the principle of transitivity to form new hypergraphs. The resulting model generates hypergraphs simulating properties observed in real world complex hypergraphs, such as densification and low average distances. We consider properties unique to hypergraphs not captured by their 2 section. We show that certain motifs, which are specified subhypergraphs of small order, have faster growth rates in ILTH hypergraphs than in random hypergraphs with the same order and expected average degree. We show that the graphs admitting a homomorphism into the 2 section of the initial hypergraph appear as induced subgraphs in the 2 section of ILTH hypergraphs. We consider new and existing hypergraph clustering coefficients, and show that these coefficients have larger values in ILTH hypergraphs than in comparable random hypergraphs.


Learning Accurate Dense Correspondences and When to Trust Them. Establishing dense correspondences between a pair of images is an important and general problem. However, dense flow estimation is often inaccurate in the case of large displacements or homogeneous regions. For most applications and down stream tasks, such as pose estimation, image manipulation, or 3D reconstruction, it is crucial to know when and where to trust the estimated matches. In this work, we aim to estimate a dense flow field relating two images, coupled with a robust pixel wise confidence map indicating the reliability and accuracy of the prediction. We develop a flexible probabilistic approach that jointly learns the flow prediction and its uncertainty. In particular, we parametrize the predictive distribution as a constrained mixture model, ensuring better modelling of both accurate flow predictions and outliers. Moreover, we develop an architecture and training strategy tailored for robust and generalizable uncertainty prediction in the context of self supervised training. Our approach obtains state of the art results on multiple challenging geometric matching and optical flow datasets. We further validate the usefulness of our probabilistic confidence estimation for the task of pose estimation. Code and models are available at https github.com PruneTruong PDCNet.


Global Functional calculus, lower upper bounds and evolution equations on manifolds with boundary. Given a smooth manifold M (with or without boundary), in this paper we establish a global functional calculus (without the standard assumption that the operators are classical pseudo differential operators) and the G r a rding inequality for global pseudo differential operators associated with boundary value problems. The analysis that we follow is free of local coordinate systems. Applications of the G r a rding inequality to the global solvability for a class of evolution problems are also considered.


Learning N M Fine grained Structured Sparse Neural Networks From Scratch. Sparsity in Deep Neural Networks (DNNs) has been widely studied to compress and accelerate the models on resource constrained environments. It can be generally categorized into unstructured fine grained sparsity that zeroes out multiple individual weights distributed across the neural network, and structured coarse grained sparsity which prunes blocks of sub networks of a neural network. Fine grained sparsity can achieve a high compression ratio but is not hardware friendly and hence receives limited speed gains. On the other hand, coarse grained sparsity cannot concurrently achieve both apparent acceleration on modern GPUs and decent performance. In this paper, we are the first to study training from scratch an N M fine grained structured sparse network, which can maintain the advantages of both unstructured fine grained sparsity and structured coarse grained sparsity simultaneously on specifically designed GPUs. Specifically, a 2 4 sparse network could achieve 2x speed up without performance drop on Nvidia A100 GPUs. Furthermore, we propose a novel and effective ingredient, sparse refined straight through estimator (SR STE), to alleviate the negative influence of the approximated gradients computed by vanilla STE during optimization. We also define a metric, Sparse Architecture Divergence (SAD), to measure the sparse network's topology change during the training process. Finally, We justify SR STE's advantages with SAD and demonstrate the effectiveness of SR STE by performing comprehensive experiments on various tasks. Source codes and models are available at https github.com NM sparsity NM sparsity.


Exploiting Invariance in Training Deep Neural Networks. Inspired by two basic mechanisms in animal visual systems, we introduce a feature transform technique that imposes invariance properties in the training of deep neural networks. The resulting algorithm requires less parameter tuning, trains well with an initial learning rate 1.0, and easily generalizes to different tasks. We enforce scale invariance with local statistics in the data to align similar samples at diverse scales. To accelerate convergence, we enforce a GL(n) invariance property with global statistics extracted from a batch such that the gradient descent solution should remain invariant under basis change. Profiling analysis shows our proposed modifications takes 5 of the computations of the underlying convolution layer. Tested on convolutional networks and transformer networks, our proposed technique requires fewer iterations to train, surpasses all baselines by a large margin, seamlessly works on both small and large batch size training, and applies to different computer vision and language tasks.


Integrated Visualization Editing via Parameterized Declarative Templates. Interfaces for creating visualizations typically embrace one of several common forms. Textual specification enables fine grained control, shelf building facilitates rapid exploration, while chart choosing promotes immediacy and simplicity. Ideally these approaches could be unified to integrate the user and usage dependent benefits found in each modality, yet these forms remain distinct. We propose parameterized declarative templates, a simple abstraction mechanism over JSON based visualization grammars, as a foundation for multimodal visualization editors. We demonstrate how templates can facilitate organization and reuse by factoring the more than 160 charts that constitute Vega Lite's example gallery into approximately 40 templates. We exemplify the pliability of abstracting over charting grammars by implementing as a template the functionality of the shelf builder Polestar (a simulacra of Tableau) and a set of templates that emulate the Google Sheets chart chooser. We show how templates support multimodal visualization editing by implementing a prototype and evaluating it through an approachability study.


Computing Voronoi Diagrams in the Polar Coordinate Model of the Hyperbolic Plane. A Voronoi diagram is a basic geometric structure that partitions the space into regions associated with a given set of sites, such that all points in a region are closer to the corresponding site than to all other sites. While being thoroughly studied in Euclidean space, they are also of interest in hyperbolic space. In fact, there are several algorithms for computing hyperbolic Voronoi diagrams that work with the various models used to describe hyperbolic geometry. However, the polar coordinate model has not been considered before, despite its increased popularity in the network science community. While Voronoi diagrams have the potential to advance this field, the model is geometrically not as approachable as other models, which impedes the development of geometric algorithms. In this paper, we present an algorithm for computing Voronoi diagrams natively in the polar coordinate model of the hyperbolic plane. The approach is based on Fortune's sweep line algorithm for Euclidean Voronoi diagrams. We characterize the hyperbolic counterparts of the concepts it utilizes, introduce adaptations necessary to account for the differences, and prove that the resulting algorithm correctly computes the Voronoi diagram in time O(n log(n)) .


Self Damaging Contrastive Learning. The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long tail distribution, and it is unclear how robustly the latest contrastive learning methods could perform in the practical scenario. This paper proposes to explicitly tackle this challenge, via a principled framework called Self Damaging Contrastive Learning (SDCLR), to automatically balance the representation learning without knowing the classes. Our main inspiration is drawn from the recent finding that deep models have difficult to memorize samples, and those may be exposed through network pruning. It is further natural to hypothesize that long tail samples are also tougher for the model to learn well due to insufficient examples. Hence, the key innovation in SDCLR is to create a dynamic self competitor model to contrast with the target model, which is a pruned version of the latter. During training, contrasting the two models will lead to adaptive online mining of the most easily forgotten samples for the current target model, and implicitly emphasize them more in the contrastive loss. Extensive experiments across multiple datasets and imbalance settings show that SDCLR significantly improves not only overall accuracies but also balancedness, in terms of linear evaluation on the full shot and few shot settings. Our code is available at https github.com VITA Group SDCLR.


Improving Apparel Detection with Category Grouping and Multi grained Branches. Training an accurate object detector is expensive and time consuming. One main reason lies in the laborious labeling process, i.e., annotating category and bounding box information for all instances in every image. In this paper, we examine ways to improve performance of deep object detectors without extra labeling. We first explore to group existing categories of high visual and semantic similarities together as one super category (or, a superclass). Then, we study how this knowledge of hierarchical categories can be exploited to better detect object using multi grained RCNN top branches. Experimental results on DeepFashion2 and OpenImagesV4 Clothing reveal that the proposed detection heads with multi grained branches can boost the overall performance by 2.3 mAP for DeepFashion2 and 2.5 mAP for OpenImagesV4 Clothing with no additional time consuming annotations. More importantly, classes that have fewer training samples tend to benefit more from the proposed multi grained heads with superclass grouping. In particular, we improve the mAP for last 30 categories (in terms of training sample number) by 2.6 and 4.6 for DeepFashion2 and OpenImagesV4 Clothing, respectively.


Using Fibonacci factors to create Fibonacci pseudoprimes. Carmichael showed for sufficiently large L , that F L has at least one prime divisor that is pm 1( rm mod , L) . For a given F L , we will show that a product of distinct odd prime divisors with that congruence condition is a Fibonacci pseudoprime. Such pseudoprimes can be used in an attempt, here unsuccessful, to find an example of a Baillie PSW pseudoprime, i.e. an odd Fibonacci pseudoprime that is congruent to pm 2( rm mod , 5) and is also a base 2 pseudoprime.


Model category structures on simplicial objects. A general method for lifting weak factorization systems in a category S to model category structures on simplicial objects in S is described, analogously to the lifting of cotorsion pairs in Abelian categories to model category structures on chain complexes. This generalizes Quillen's original treatment of (projective) model category structures on simplicial objects. As a new application we show that there is always a model category structure on simplicial objects in the coproduct completion of any (even large) category S with finite limits, which if S is small defines the same homotopy theory as any global model category of simplicial pre sheaves on S. If S is, in addition, extensive, a similar model category structure exists on simplicial objects in S itself. In any case the associated left derivator exists on all diagrams despite the lack of colimits in the original category.


Extending infinitely many times arithmetically Cohen Macaulay and Gorenstein subvarieties of projective spaces. We give examples of infinitely extendable (not as cones) arithmetically Cohen Macaulay and arithmetically Gorenstein subvarieties of projective spaces and which are not complete intersections. The proof uses the computation of the dimension of the Hilbert scheme of codimension 2 subschemes of projective spaces due to G. Ellingsrud and of arithmetically Gorenstein codimension 3 subschemes due to J. O. Kleppe and R. M. Mir ' o Roig.


Lie complexity of words. Given a finite alphabet Sigma and a right infinite word bf w over Sigma , we define the Lie complexity function L bf w mathbb N to mathbb N , whose value at n is the number of conjugacy classes (under cyclic shift) of length n factors x of bf w with the property that every element of the conjugacy class appears in bf w . We show that the Lie complexity function is uniformly bounded for words with linear factor complexity, and as a result we show that words of linear factor complexity have at most finitely many primitive factors y with the property that y n is again a factor for every n . We then look at automatic sequences and show that the Lie complexity function of a k automatic sequence is again k automatic.


Minimum Principle on Specific Entropy and High Order Accurate Invariant Region Preserving Numerical Methods for Relativistic Hydrodynamics. This paper explores Tadmor's minimum entropy principle for the relativistic hydrodynamics (RHD) equations and incorporates this principle into the design of robust high order discontinuous Galerkin (DG) and finite volume schemes for RHD on general meshes. The schemes are proven to preserve numerical solutions in a global invariant region constituted by all the known intrinsic constraints minimum entropy principle, the subluminal constraint on fluid velocity, and the positivity of pressure and rest mass density. Relativistic effects lead to some essential difficulties in the present study, which are not encountered in the non relativistic case. Most notably, in the RHD case the specific entropy is a highly nonlinear implicit function of the conservative variables, and, moreover, there is also no explicit formula of the flux in terms of the conservative variables. In order to overcome the resulting challenges, we first propose a novel equivalent form of the invariant region, by skillfully introducing two auxiliary variables. As a notable feature, all the constraints in the novel form are explicit and linear with respect to the conservative variables. This provides a highly effective approach to theoretically analyze the invariant region preserving (IRP) property of schemes for RHD, without any assumption on the IRP property of the exact Riemann solver. Based on this, we prove the convexity of the invariant region and establish the generalized Lax Friedrichs splitting properties via technical estimates, lying the foundation for our IRP analysis. It is shown that the first order Lax Friedrichs scheme for RHD satisfies a local minimum entropy principle and is IRP under a CFL condition. Provably IRP high order DG and finite volume methods are developed for the RHD with the help of a simple scaling limiter. Several numerical examples demonstrate the effectiveness of the proposed schemes.


On the minimum number of high degree curves containing few points. In this paper we state two quantitative Sylvester Gallai results for high degree curves. Moreover we give two constructions which show that these results are not trivial.


Multi modal Motion Prediction with Transformer based Neural Network for Autonomous Driving. Predicting the behaviors of other agents on the road is critical for autonomous driving to ensure safety and efficiency. However, the challenging part is how to represent the social interactions between agents and output different possible trajectories with interpretability. In this paper, we introduce a neural prediction framework based on the Transformer structure to model the relationship among the interacting agents and extract the attention of the target agent on the map waypoints. Specifically, we organize the interacting agents into a graph and utilize the multi head attention Transformer encoder to extract the relations between them. To address the multi modality of motion prediction, we propose a multi modal attention Transformer encoder, which modifies the multi head attention mechanism to multi modal attention, and each predicted trajectory is conditioned on an independent attention mode. The proposed model is validated on the Argoverse motion forecasting dataset and shows state of the art prediction accuracy while maintaining a small model size and a simple training process. We also demonstrate that the multi modal attention module can automatically identify different modes of the target agent's attention on the map, which improves the interpretability of the model.


On the anisotropy and Lefschetz property for PL spheres. A simplicial sphere Delta is said to be generically anisotropic over a field mathbb F if, for a certain purely transcendental field extension mathbf k of mathbb F , a certain Artinian reduction A of the face ring mathbf k Delta has the following property For every nonzero homogeneous element alpha in A of degree at most ( dim Delta 1) 2 , its square alpha 2 is also nonzero. The importance of this property is that the hard Lefschetz property for simplicial spheres can be derived from it. A recent result of Papadakis and Petrotou shows that every simplicial sphere is generically anisotropic over any field of characteristic 2 . In this paper, we give an equivalent condition of being generically anisotropic, and use it to present a simplified proof of Papadakis Petrotou theorem for PL spheres. We also prove that the simplicial spheres of dimension 2 are generically anisotropic over any field mathbb F .


On the Explanatory Power of Decision Trees. Decision trees have long been recognized as models of choice in sensitive applications where interpretability is of paramount importance. In this paper, we examine the computational ability of Boolean decision trees in deriving, minimizing, and counting sufficient reasons and contrastive explanations. We prove that the set of all sufficient reasons of minimal size for an instance given a decision tree can be exponentially larger than the size of the input (the instance and the decision tree). Therefore, generating the full set of sufficient reasons can be out of reach. In addition, computing a single sufficient reason does not prove enough in general indeed, two sufficient reasons for the same instance may differ on many features. To deal with this issue and generate synthetic views of the set of all sufficient reasons, we introduce the notions of relevant features and of necessary features that characterize the (possibly negated) features appearing in at least one or in every sufficient reason, and we show that they can be computed in polynomial time. We also introduce the notion of explanatory importance, that indicates how frequent each (possibly negated) feature is in the set of all sufficient reasons. We show how the explanatory importance of a feature and the number of sufficient reasons can be obtained via a model counting operation, which turns out to be practical in many cases. We also explain how to enumerate sufficient reasons of minimal size. We finally show that, unlike sufficient reasons, the set of all contrastive explanations for an instance given a decision tree can be derived, minimized and counted in polynomial time.


BiAdam Fast Adaptive Bilevel Optimization Methods. Bilevel optimization recently has attracted increased interest in machine learning due to its many applications such as hyper parameter optimization and policy optimization. Although some methods recently have been proposed to solve the bilevel problems, these methods do not consider using adaptive learning rates. To fill this gap, in the paper, we propose a class of fast and effective adaptive methods for solving bilevel optimization problems that the outer problem is possibly nonconvex and the inner problem is strongly convex. Specifically, we propose a fast single loop BiAdam algorithm based on the basic momentum technique, which achieves a sample complexity of tilde O ( epsilon 4 ) for finding an epsilon stationary point. At the same time, we propose an accelerated version of BiAdam algorithm (VR BiAdam) by using variance reduced technique, which reaches the best known sample complexity of tilde O ( epsilon 3 ) . To further reduce computation in estimating derivatives, we propose a fast single loop stochastic approximated BiAdam algorithm (saBiAdam) by avoiding the Hessian inverse, which still achieves a sample complexity of tilde O ( epsilon 4 ) without large batches. We further present an accelerated version of saBiAdam algorithm (VR saBiAdam), which also reaches the best known sample complexity of tilde O ( epsilon 3 ) . We apply the unified adaptive matrices to our methods as the SUPER ADAM citep huang2021super , which including many types of adaptive learning rates. Moreover, our framework can flexibly use the momentum and variance reduced techniques. In particular, we provide a useful convergence analysis framework for both the constrained and unconstrained bilevel optimization. To the best of our knowledge, we first study the adaptive bilevel optimization methods with adaptive learning rates.


Double RIS Communication with DF Relaying for Coverage Extension Is One Relay Enough?. In this work, we investigate the decode and forward (DF) relay aided double reconfigurable intelligent surface (RIS) assisted networks, where the signal is subject to reflections from two RISs before reaching the destination. Different relay aided network architectures are considered for maximum achievable rate under a total power constraint. Phase optimization for the double RIS channels is tackled via the alternating optimization and majorization minimization (MM) schemes. Moreover, closed form solutions are obtained for each case. Numerical results indicate that the deployment of two relays, one near each RIS, achieves higher rates at low and medium signal to noise ratios (SNRs) compared to placing a single relay between the two RISs while at high SNRs, the latter approach achieves higher rates only if the inter relay interference for the former case is considerably high.


Generative Optimization Networks for Memory Efficient Data Generation. In standard generative deep learning models, such as autoencoders or GANs, the size of the parameter set is proportional to the complexity of the generated data distribution. A significant challenge is to deploy resource hungry deep learning models in devices with limited memory to prevent system upgrade costs. To combat this, we propose a novel framework called generative optimization networks (GON) that is similar to GANs, but does not use a generator, significantly reducing its memory footprint. GONs use a single discriminator network and run optimization in the input space to generate new data samples, achieving an effective compromise between training time and memory consumption. GONs are most suited for data generation problems in limited memory settings. Here we illustrate their use for the problem of anomaly detection in memory constrained edge devices arising from attacks or intrusion events. Specifically, we use a GON to calculate a reconstruction based anomaly score for input time series windows. Experiments on a Raspberry Pi testbed with two existing and a new suite of datasets show that our framework gives up to 32 higher detection F1 scores and 58 lower memory consumption, with only 5 higher training overheads compared to the state of the art.


Leveraging Local Domains for Image to Image Translation. Image to image (i2i) networks struggle to capture local changes because they do not affect the global scene structure. For example, translating from highway scenes to offroad, i2i networks easily focus on global color features but ignore obvious traits for humans like the absence of lane markings. In this paper, we leverage human knowledge about spatial domain characteristics which we refer to as 'local domains' and demonstrate its benefit for image to image translation. Relying on a simple geometrical guidance, we train a patch based GAN on few source data and hallucinate a new unseen domain which subsequently eases transfer learning to target. We experiment on three tasks ranging from unstructured environments to adverse weather. Our comprehensive evaluation setting shows we are able to generate realistic translations, with minimal priors, and training only on a few images. Furthermore, when trained on our translations images we show that all tested proxy tasks are significantly improved, without ever seeing target domain at training.


Generalized Domain Conditioned Adaptation Network. Domain Adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain specialized features because most studies merely concentrate on domain general feature learning in task specific layers and integrate totally shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi path structure to separately excite channel activation for each domain. Such a partially shared convnets module allows domain specialized features in low level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high level feature distributions across domains, we consider deploying feature adaptation blocks after task specific layers, which can explicitly mitigate the domain discrepancy.


Symbolic dynamics for the anisotropic N centre problem at negative energies. The planar N centre problem describes the motion of a particle moving in the plane under the action of the force fields of N fixed attractive centres ddot x (t) sum j 1 N nabla V j(x c j). In this paper we prove symbolic dynamics at slightly negative energy for an N centre problem where the potentials V j are positive, anisotropic and homogeneous of degree alpha j V j(x) x alpha j V j left( frac x x right). The proof is based on a broken geodesics argument and trajectories are extremals of the Maupertuis' functional. Compared with the classical N centre problem with Kepler potentials, a major difficulty arises from the lack of a regularization of the singularities. We will consider both the collisional dynamics and the non collision one. Symbols describe geometric and topological features of the associated trajectory.


Optimizing Age of Information in Random Access Poisson Networks. Timeliness is an emerging requirement for many Internet of Things (IoT) applications. In IoT networks, where a large number of nodes are distributed, severe interference may incur during the transmission phase which causes age of information (AoI) degradation. It is therefore important to study the performance limit of AoI as well as how to achieve such limit. In this paper, we aim to optimize the AoI in random access Poisson networks. By taking into account the spatio temporal interactions amongst the transmitters, an expression of the peak AoI is derived, based on explicit expressions of the optimal peak AoI and the corresponding optimal system parameters including the packet arrival rate and the channel access probability are further derived. It is shown that with a given packet arrival rate (resp. a given channel access probability), the optimal channel access probability (resp. the optimal packet arrival rate), is equal to one under a small node deployment density, and decrease monotonically as the spatial deployment density increases due to the severe interference caused by spatio temproal coupling between transmitters. When joint tuning of the packet arrival rate and channel access probability is performed, the optimal channel access probability is always set to be one. Moreover, with the sole tuning of the channel access probability, it is found that the optimal peak AoI performance can be improved with a smaller packet arrival rate only when the node deployment density is high, which is contrast to the case of the sole tuning of the packet arrival rate, where a higher channel access probability always leads to better optimal peak AoI regardless of the node deployment density. In all the cases of optimal tuning of system parameters, the optimal peak AoI linearly grows with the node deployment density as opposed to an exponential growth with fixed system parameters.


A Refined Complexity Analysis of Fair Districting over Graphs. We study the NP hard Fair Connected Districting problem recently proposed by Stoica et al. AAMAS 2020 Partition a vertex colored graph into k connected components (subsequently referred to as districts) so that in every district the most frequent color occurs at most a given number of times more often than the second most frequent color. Fair Connected Districting is motivated by various real world scenarios where agents of different types, which are one to one represented by nodes in a network, have to be partitioned into disjoint districts. Herein, one strives for "fair districts" without any type being in a dominating majority in any of the districts. This is to e.g. prevent segregation or political domination of some political party. We conduct a fine grained analysis of the (parameterized) computational complexity of Fair Connected Districting. In particular, we prove that it is polynomial time solvable on paths, cycles, stars, and caterpillars, but already becomes NP hard on trees. Motivated by the latter negative result, we perform a parameterized complexity analysis with respect to various graph parameters, including treewidth, and problem specific parameters, including, the numbers of colors and districts. We obtain a rich and diverse, close to complete picture of the corresponding parameterized complexity landscape (that is, a classification along the complexity classes FPT, XP, W 1 hard, and para NP hard).


Real time detection of uncalibrated sensors using Neural Networks. Nowadays, sensors play a major role in several contexts like science, industry and daily life which benefit of their use. However, the retrieved information must be reliable. Anomalies in the behavior of sensors can give rise to critical consequences such as ruining a scientific project or jeopardizing the quality of the production in industrial production lines. One of the more subtle kind of anomalies are uncalibrations. An uncalibration is said to take place when the sensor is not adjusted or standardized by calibration according to a ground truth value. In this work, an online machine learning based uncalibration detector for temperature, humidity and pressure sensors was developed. This solution integrates an Artificial Neural Network as main component which learns from the behavior of the sensors under calibrated conditions. Then, after trained and deployed, it detects uncalibrations once they take place. The obtained results show that the proposed solution is able to detect uncalibrations for deviation values of 0.25 degrees, 1 RH and 1.5 Pa, respectively. This solution can be adapted to different contexts by means of transfer learning, whose application allows for the addition of new sensors, the deployment into new environments and the retraining of the model with minimum amounts of data.


Sharp spectral variations of the ultrafast transient light extinction by bimetallic nanoparticles in the near UV. Noble metal nanoparticles exhibit localized plasmon resonance modes that span the visible and near infrared spectral ranges and have many applications. Modifying the size, shape, and composition of the nanoparticles changes the number of modes and their properties. The characteristics of these modes are transiently affected when illuminating the nano objects with ultrashort laser pulses. Here, we synthesize core shell gold silver nanocuboids and measure their spectral signature in the stationary and ultrafast transient regimes. Their dipolar transverse mode vanishes with increasing Ag shell thickness, while higher order modes grow in the near ultraviolet range where no plasmon resonance can be generated with single noble metal nanoparticles. These higher energy modes are associated with sharp spectral variations of the ultrafast transient light extinction by the bimetallic nanocuboids. By carrying out a theoretical investigation, we break down the different contributions to this response and


Spectral and norm estimates for matrix sequences arising from a finite difference approximation of elliptic operators. When approximating elliptic problems by using specialized approximation techniques, we obtain large structured matrices whose analysis provides information on the stability of the method. Here we provide spectral and norm estimates for matrix sequences arising from the approximation of the Laplacian via ad hoc finite differences. The analysis involves several tools from matrix theory and in particular from the setting of Toeplitz operators and Generalized Locally Toeplitz matrix sequences. Several numerical experiments are conducted, which confirm the correctness of the theoretical findings.


Deep Reinforcement Learning for Adaptive Exploration of Unknown Environments. Performing autonomous exploration is essential for unmanned aerial vehicles (UAVs) operating in unknown environments. Often, these missions start with building a map for the environment via pure exploration and subsequently using (i.e. exploiting) the generated map for downstream navigation tasks. Accomplishing these navigation tasks in two separate steps is not always possible or even disadvantageous for UAVs deployed in outdoor and dynamically changing environments. Current exploration approaches either use a priori human generated maps or use heuristics such as frontier based exploration. Other approaches use learning but focus only on learning policies for specific tasks by either using sample inefficient random exploration or by making impractical assumptions about full map availability. In this paper, we develop an adaptive exploration approach to trade off between exploration and exploitation in one single step for UAVs searching for areas of interest (AoIs) in unknown environments using Deep Reinforcement Learning (DRL). The proposed approach uses a map segmentation technique to decompose the environment map into smaller, tractable maps. Then, a simple information gain function is repeatedly computed to determine the best target region to search during each iteration of the process. DDQN and A2C algorithms are extended with a stack of LSTM layers and trained to generate optimal policies for the exploration and exploitation, respectively. We tested our approach in 3 different tasks against 4 baselines. The results demonstrate that our proposed approach is capable of navigating through randomly generated environments and covering more AoI in less time steps compared to the baselines.


Simulating linear kinematic features in viscous plastic sea ice models on quadrilateral and triangular grids. Linear Kinematic Features (LKFs) are found everywhere in the Arctic sea ice cover. They are strongly localized deformations often associated with the formation of leads and pressure ridges. Viscous plastic sea ice models start to generate LKFs at high spatial grid resolution, typically with a grid spacing below 5 km. Besides grid spacing, other aspects of a numerical implementation, such as discretization details, may affect the number and definition of simulated LKFs. To explore these effects, the solutions of sea ice models with different grid spacings, mesh types, and numerical discretization techniques are compared in an idealized configuration, which could also serve as a benchmark problem in the future. The A, B, and C grid discretizations of sea ice dynamics on quadrilateral meshes leads to a similar number of LKFs as the A grid approximation on triangular meshes (with the same number of vertices). The discretization on an Arakawa CD grid on both structured quadrilateral and triangular meshes resolves the same number of LKFs as conventional Arakawa A grid, B grid, and C grid approaches, but on two times coarser meshes. This is due to the fact that the CD grid approach has a higher number of degrees of freedom to discretize the velocity field. Due to its enhanced resolving properties, the CD grid discretization is an attractive alternative to conventional discretizations.


BEVT BERT Pretraining of Video Transformers. This paper studies the BERT pretraining of video transformers. It is a straightforward but worth studying extension given the recent success from BERT pretraining of image transformers. We introduce BEVT which decouples video representation learning into spatial representation learning and temporal dynamics learning. In particular, BEVT first performs masked image modeling on image data, and then conducts masked image modeling jointly with masked video modeling on video data. This design is motivated by two observations 1) transformers learned on image datasets provide decent spatial priors that can ease the learning of video transformers, which are often times computationally intensive if trained from scratch 2) discriminative clues, i.e., spatial and temporal information, needed to make correct predictions vary among different videos due to large intra class and inter class variations. We conduct extensive experiments on three challenging video benchmarks where BEVT achieves very promising results. On Kinetics 400, for which recognition mostly relies on discriminative spatial representations, BEVT achieves comparable results to strong supervised baselines. On Something Something V2 and Diving 48, which contain videos relying on temporal dynamics, BEVT outperforms by clear margins all alternative baselines and achieves state of the art performance with a 71.4 and 87.2 Top 1 accuracy respectively. Code will be made available at url https github.com xyzforever BEVT .


Benchmarking the Status of Default Pseudorandom Number Generators in Common Programming Languages. The ever increasing need for random numbers is clear in many areas of computer science, from neural networks to optimization. As such, most common programming language provide easy access to Pseudorandom Number Generators. However, these generators are not all made equal, and empirical verification has previously shown some to be flawed in key ways. Because of the constant changes in programming languages, we perform the same empirical benchmarking using large batteries of statistcal tests on a wide array of PRNGs, and identify that while some languages have improved significantly over the years, there are still cases where the default PRNG fails to deliver sufficiently random results.


Stein kernels for q moment measures and new bounds for the rate of convergence in the central limit theorem. Given an isotropic probability measure mu on mathbb R d with rm d mu left( x right) left( varrho left( x right) right) alpha rm d x , where alpha d 1 and varrho mathbb R d to left( 0, infty right) is a continuous function and uniformly convex ( nabla 2 varrho ge varepsilon 0 rm Id ). By using Stein kernels for left( alpha d right) moment measures, we prove that the rates of convergence in the central limit theorem with sequence of i.i.d. random variables X 1 , X 2 ,..., X n of the law mu , to be of form c varepsilon 0 , sqrt dfrac d n . The general case (i.e., varrho is only convex and continuous) remains open.


Defining Blockchain Governance Principles A Comprehensive Framework. Blockchain eliminates the need for trusted third party intermediaries in business by enabling decentralised architecture in software applications. However, vulnerabilities in on chain autonomous decision making and cumbersome off chain coordination have led to serious concerns about blockchain's ability to behave and make decisions in a trustworthy and efficient way. Blockchain governance has received considerable attention to support the decision making process during the use and evolution of blockchain. Nevertheless, conventional governance frameworks are not applicable to blockchain due to its inherent distributed architecture and decentralised decision process, which leads to the absence of clear source of authority. Currently, there is a lack of systematic guidance on how blockchain governance can be implemented. Therefore, in this paper, we present a comprehensive blockchain governance framework that elucidates an integrated view of the degree of decentralisation, decision rights, incentives, accountability, ecosystem, and legal and ethical responsibilities. The proposed framework is evaluated using four well known blockchain platforms in terms of feasibility, applicability, and usability.


A Theorem of Congruent Primes. To determine whether a number is congruent or not is an old and difficult topic and progress is slow. The paper presents a new theorem when a prime number is a congruent number or not. The proof is not necessarily any simpler or shorter than existing proofs, but the method may be useful in other contexts. The proof of Theorem 1 tracks the set of solutions and this set branches as a binary tree. Conditions set to the theorem restricts the branches so that only one branch is left. Following this branch gives either a solution or a contradiction. In Theorem 1 it leads to a contradiction. The interest is in the proof method, which maybe can be generalized to non primes.


A categorification of the colored Jones polynomial at a root of unity. There is a p differential on the triply graded Khovanov Rozansky homology of knots and links over a field of positive characteristic p that gives rise to an invariant in the homotopy category finite dimensional p complexes. A differential on triply graded homology discovered by Cautis is compatible with the p differential structure. As a consequence we get a categorification of the colored Jones polynomial evaluated at a 2p th root of unity.


Why and How Governments Should Monitor AI Development. In this paper we outline a proposal for improving the governance of artificial intelligence (AI) by investing in government capacity to systematically measure and monitor the capabilities and impacts of AI systems. If adopted, this would give governments greater information about the AI ecosystem, equipping them to more effectively direct AI development and deployment in the most societally and economically beneficial directions. It would also create infrastructure that could rapidly identify potential threats or harms that could occur as a consequence of changes in the AI ecosystem, such as the emergence of strategically transformative capabilities, or the deployment of harmful systems. We begin by outlining the problem which motivates this proposal in brief, traditional governance approaches struggle to keep pace with the speed of progress in AI. We then present our proposal for addressing this problem governments must invest in measurement and monitoring infrastructure. We discuss this proposal in detail, outlining what specific things governments could focus on measuring and monitoring, and the kinds of benefits this would generate for policymaking. Finally, we outline some potential pilot projects and some considerations for implementing this in practice.


Twisted cubic and point line incidence matrix in mathrm PG (3,q) . We consider the structure of the point line incidence matrix of the projective space mathrm PG (3,q) connected with orbits of points and lines under the stabilizer group of the twisted cubic. Structures of submatrices with incidences between a union of line orbits and an orbit of points are investigated. For the unions consisting of two or three line orbits, the original submatrices are split into new ones, in which the incidences are also considered. For each submatrix (apart from the ones corresponding to a special type of lines), the numbers of lines through every point and of points lying on every line are obtained. This corresponds to the numbers of ones in columns and rows of the submatrices.


Character level HyperNetworks for Hate Speech Detection. The massive spread of hate speech, hateful content targeted at specific subpopulations, is a problem of critical social importance. Automated methods for hate speech detection typically employ state of the art deep learning (DL) based text classifiers very large pre trained neural language models of over 100 million parameters, adapting these models to the task of hate speech detection using relevant labeled datasets. Unfortunately, there are only numerous labeled datasets of limited size that are available for this purpose. We make several contributions with high potential for advancing this state of affairs. We present HyperNetworks for hate speech detection, a special class of DL networks whose weights are regulated by a small scale auxiliary network. These architectures operate at character level, as opposed to word level, and are several magnitudes of order smaller compared to the popular DL classifiers. We further show that training hate detection classifiers using large amounts of automatically generated examples in a procedure named as it data augmentation is beneficial in general, yet this practice especially boosts the performance of the proposed HyperNetworks. In fact, we achieve performance that is comparable or better than state of the art language models, which are pre trained and orders of magnitude larger, using this approach, as evaluated using five public hate speech datasets.


On the periodicity of cardiovascular fluid dynamics simulations. Three dimensional cardiovascular fluid dynamics simulations typically require computation of several cardiac cycles before they reach a periodic solution, rendering them computationally expensive. Furthermore, there is currently no standardized method to determine whether a simulation has yet reached that periodic state. In this work, we propose use of the asymptotic error measure to quantify the difference between simulation results and their ideal periodic state using lumped parameter modeling. We further show that initial conditions are crucial in reducing computational time and develop an automated framework to generate appropriate initial conditions from a one dimensional model of blood flow. We demonstrate the performance of our initialization method using six patient specific models from the Vascular Model Repository. In our examples, our initialization protocol achieves periodic convergence within one or two cardiac cycles, leading to a significant reduction in computational cost compared to standard methods. All computational tools used in this work are implemented in the open source software platform SimVascular. Automatically generated initial conditions have the potential to significantly reduce computation time in cardiovascular fluid dynamics simulations.


Optimal Construction for Time Convex Hull with Two Orthogonal Highways in the L1 metric. We consider the time convex hull problem in the presence of two orthogonal highways H. In this problem, the travelling speed on the highway is faster than off the highway, and the time convex hull of a point set P is the closure of P with respect to the inclusion of shortest time paths. In this paper, we provide the algorithm for constructing the time convex hull with two orthogonal highways. We reach the optimal result of O(n log n) time for arbitrary highway speed in the L1 metric. For the L2 metric with infinite highway speed, we hit the goal of O(n log n) time as well.


Model Based Policy Search Using Monte Carlo Gradient Estimation with Real Systems Application. In this paper, we present a Model Based Reinforcement Learning algorithm named Monte Carlo Probabilistic Inference for Learning COntrol (MC PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics and on a Monte Carlo approach to estimate the policy gradient. This defines a framework in which we ablate the choice of the following components (i) the selection of the cost function, (ii) the optimization of policies using dropout, (iii) an improved data efficiency through the use of structured kernels in the GP models. The combination of the aforementioned aspects affects dramatically the performance of MC PILCO. Numerical comparisons in a simulated cart pole environment show that MC PILCO exhibits better data efficiency and control performance w.r.t. state of the art GP based MBRL algorithms. Finally, we apply MC PILCO to real systems, considering in particular systems with partially measurable states. We discuss the importance of modeling both the measurement system and the state estimators during policy optimization. The effectiveness of the proposed solutions has been tested in simulation and in two real systems, a Furuta pendulum and a ball and plate.


Adversarial Branch Architecture Search for Unsupervised Domain Adaptation. Unsupervised Domain Adaptation (UDA) is a key issue in visual recognition, as it allows to bridge different visual domains enabling robust performances in the real world. To date, all proposed approaches rely on human expertise to manually adapt a given UDA method (e.g. DANN) to a specific backbone architecture (e.g. ResNet). This dependency on handcrafted designs limits the applicability of a given approach in time, as old methods need to be constantly adapted to novel backbones. Existing Neural Architecture Search (NAS) approaches cannot be directly applied to mitigate this issue, as they rely on labels that are not available in the UDA setting. Furthermore, most NAS methods search for full architectures, which precludes the use of pre trained models, essential in a vast range of UDA settings for reaching SOTA results. To the best of our knowledge, no prior work has addressed these aspects in the context of NAS for UDA. Here we tackle both aspects with an Adversarial Branch Architecture Search for UDA (ABAS) i. we address the lack of target labels by a novel data driven ensemble approach for model selection and ii. we search for an auxiliary adversarial branch, attached to a pre trained backbone, which drives the domain alignment. We extensively validate ABAS to improve two modern UDA techniques, DANN and ALDA, on three standard visual recognition datasets (Office31, Office Home and PACS). In all cases, ABAS robustly finds the adversarial branch architectures and parameters which yield best performances.


Global Well Posedness For Half Wave Maps With S 2 and mathbb H 2 Targets For Small Smooth Initial Data. We prove global well posedness for the half wave map with S 2 target for small dot H frac n 2 times dot H frac n 2 1 initial data. We also prove the global well posedness for the equation with mathbb H 2 target for small smooth dot B frac n 2 2,1 times dot B frac n 2 1 2,1 initial data.


Decision Support Models for Predicting and Explaining Airport Passenger Connectivity from Data. Predicting if passengers in a connecting flight will lose their connection is paramount for airline profitability. We present novel machine learning based decision support models for the different stages of connection flight management, namely for strategic, pre tactical, tactical and post operations. We predict missed flight connections in an airline's hub airport using historical data on flights and passengers, and analyse the factors that contribute additively to the predicted outcome for each decision horizon. Our data is high dimensional, heterogeneous, imbalanced and noisy, and does not inform about passenger arrival departure transit time. We employ probabilistic encoding of categorical classes, data balancing with Gaussian Mixture Models, and boosting. For all planning horizons, our models attain an AUC of the ROC higher than 0.93. SHAP value explanations of our models indicate that scheduled perceived connection times contribute the most to the prediction, followed by passenger age and whether border controls are required.


Environmental Variable Monitoring with IoT Technology. This article describes the design of a flexible and low cost platform for monitoring environmental variables applied to agriculture. For the construction of this platform, technologies based on the communication protocol, Wi Fi, Bluetooth, and Zigbee were used, using the embedded Raspberry pi 3 b system and sensors to quantify different environmental variables, using different open source hardware and software tools. The network is made up of a central node (gateway), implemented on Samsung's Artik 1020 card, and two nodes where the sensors for reading environmental variables are connected. Finally, the data is collected by the gateway, which will be in charge of processing and storing it in a database so that the user in the future can access the information in real time from anywhere.


Coreference Resolution without Span Representations. The introduction of pretrained language models has reduced many complex task specific NLP models to simple lightweight layers. An exception to this trend is coreference resolution, where a sophisticated task specific model is appended to a pretrained transformer encoder. While highly effective, the model has a very large memory footprint primarily due to dynamically constructed span and span pair representations which hinders the processing of complete documents and the ability to train on multiple instances in a single batch. We introduce a lightweight end to end coreference model that removes the dependency on span representations, handcrafted features, and heuristics. Our model performs competitively with the current standard model, while being simpler and more efficient.


Optimal Maximal Leakage Distortion Tradeoff. Most methods for publishing data with privacy guarantees introduce randomness into datasets which reduces the utility of the published data. In this paper, we study the privacy utility tradeoff by taking maximal leakage as the privacy measure and the expected Hamming distortion as the utility measure. We study three different but related problems. First, we assume that the data generating distribution (i.e., the prior) is known, and we find the optimal privacy mechanism that achieves the smallest distortion subject to a constraint on maximal leakage. Then, we assume that the prior belongs to some set of distributions, and we formulate a min max problem for finding the smallest distortion achievable for the worst case prior in the set, subject to a maximal leakage constraint. Lastly, we define a partial order on privacy mechanisms based on the largest distortion they generate. Our results show that when the prior distribution is known, the optimal privacy mechanism fully discloses symbols with the largest prior probabilities, and suppresses symbols with the smallest prior probabilities. Furthermore, we show that sets of priors that contain more uniform distributions lead to larger distortion, while privacy mechanisms that distribute the privacy budget more uniformly over the symbols create smaller worst case distortion.


Global boundedness and maximum principle for a Brezis Oswald approach to mixed local and nonlocal operators. In this paper we provide necessary and sufficient conditions for the existence of a unique positive weak solution for some sublinear Dirichlet problems driven by the sum of a quasilinear local and a nonlocal operator, i.e., mathcal L p,s Delta p ( Delta) s p. Our main result is resemblant to the celebrated work by Brezis Oswald 10 . In addition, we prove a regularity result of independent interest.


Hybrid Graph Neural Networks for Few Shot Learning. Graph neural networks (GNNs) have been used to tackle the few shot learning (FSL) problem and shown great potentials under the transductive setting. However under the inductive setting, existing GNN based methods are less competitive. This is because they use an instance GNN as a label propagation classification module, which is jointly meta learned with a feature embedding network. This design is problematic because the classifier needs to adapt quickly to new tasks while the embedding does not. To overcome this problem, in this paper we propose a novel hybrid GNN (HGNN) model consisting of two GNNs, an instance GNN and a prototype GNN. Instead of label propagation, they act as feature embedding adaptation modules for quick adaptation of the meta learned feature embedding to new tasks. Importantly they are designed to deal with a fundamental yet often neglected challenge in FSL, that is, with only a handful of shots per class, any few shot classifier would be sensitive to badly sampled shots which are either outliers or can cause inter class distribution overlapping. Our two GNNs are designed to address these two types of poorly sampled few shots respectively and their complementarity is exploited in the hybrid GNN model. Extensive experiments show that our HGNN obtains new state of the art on three FSL benchmarks.


Periodic Updates for Constrained OCO with Application to Large Scale Multi Antenna Systems. In many dynamic systems, decisions on system operation are updated over time, and the decision maker requires an online learning approach to optimize its strategy in response to the changing environment. When the loss and constraint functions are convex, this belongs to the general family of online convex optimization (OCO). In existing OCO works, the environment is assumed to vary in a time slotted fashion, while the decisions are updated at each time slot. However, many wireless communication systems permit only periodic decision updates, i.e., each decision is fixed over multiple time slots, while the environment changes between the decision epochs. The standard OCO model is inadequate for these systems. Therefore, in this work, we consider periodic decision updates for OCO. We aim to minimize the accumulation of time varying convex loss functions, subject to both short term and long term constraints. Information about the loss functions within the current update period may be incomplete and is revealed to the decision maker only after the decision is made. We propose an efficient algorithm, termed Periodic Queueing and Gradient Aggregation (PQGA), which employs novel periodic queues together with possibly multi step aggregated gradient descent to update the decisions over time. We derive upper bounds on the dynamic regret, static regret, and constraint violation of PQGA. As an example application, we study the performance of PQGA in a large scale multi antenna system shared by multiple wireless service providers. Simulation results show that PQGA converges fast and substantially outperforms the known best alternative.


The de Rham Fargues Fontaine cohomology. We show how to attach to any rigid analytic variety V over a perfectoid space P a rigid analytic motive over the Fargues Fontaine curve mathcal X (P) functorially in V and P . We combine this construction with the overconvergent relative de Rham cohomology to produce a complex of solid quasi coherent sheaves over mathcal X (P) , and we show that its cohomology groups are vector bundles if V is smooth and proper over P or if V is quasi compact and P is a perfectoid field, thus proving and generalizing a conjecture of Scholze. The main ingredients of the proofs are explicit mathbb B 1 homotopies, the motivic proper base change and the formalism of solid quasi coherent sheaves.


On the Complexity of Load Balancing in Dynamic Networks. In the load balancing problem, each node in a network is assigned a load, and the goal is to equally distribute the loads among the nodes, by preforming local load exchanges. While load balancing was extensively studied in static networks, only recently a load balancing algorithm for dynamic networks with a bounded convergence time was presented. In this paper, we further study the time complexity of load balancing in the context of dynamic networks. First, we show that randomness is not necessary, and present a deterministic algorithm which slightly improves the running time of the previous algorithm, at the price of not being matching based. Then, we consider integral loads, i.e., loads that cannot be split indefinitely, and prove that no matching based algorithm can have a bounded convergence time for this case. To circumvent both this impossibility result, and a known one for the non integral case, we apply the method of smoothed analysis, where random perturbations are made over the worst case choices of network topologies. We show both impossibility results do not hold under this kind of analysis, suggesting that load balancing in real world systems might be faster than the lower bounds suggest.


Rational D(q) quintuples. For a nonzero rational number q , a rational D(q) n tuple is a set of n distinct nonzero rationals a 1, a 2, dots, a n such that a ia j q is a square for all 1 leqslant i j leqslant n . We investigate for which q there exist infinitely many rational D(q) quintuples. We show that assuming the Parity Conjecture for the twists of several explicitly given elliptic curves, the density of such q is at least 295026 296010 approx 99.5 .


Universal scaling laws rule explosive growth inhuman cancers. Most physical and other natural systems are complex entities composed of a large number of interacting individual elements. It is a surprising fact that they often obey the so called scaling laws relating an observable quantity with a measure of the size of the system. Here we describe the discovery of universal superlinear metabolic scaling laws in human cancers. This dependence underpins increasing tumour aggressiveness, due to evolutionary dynamics, which leads to an explosive growth as the disease progresses. We validated this dynamic using longitudinal volumetric data of different histologies from large cohorts of cancer patients. To explain our observations we put forward increasingly complex biologically inspired mathematical models that captured the key processes governing tumor growth. Our models predicted that the emergence of superlinear allometric scaling laws is an inherently three dimensional phenomenon. Moreover, the scaling laws thereby identified allowed us to define a set of metabolic metrics with prognostic value, thus providing added clinical utility to the base findings.


A Survey on Metaverse the State of the art, Technologies, Applications, and Challenges. Metaverse is a new type of Internet application and social form that integrates a variety of new technologies. It has the characteristics of multi technology, sociality, and hyper spatiotemporality. This paper introduces the development status of Metaverse, from the five perspectives of network infrastructure, management technology, basic common technology, virtual reality object connection, and virtual reality convergence, it introduces the technical framework of Metaverse. This paper also introduces the nature of Metaverse's social and hyper spatiotemporality, and discusses the first application areas of Metaverse and some of the problems and challenges it may face.


A Refinement of Carlson's Theorem. Carlson's theorem estimates the growth of an analytic function along the imaginary axis, provided that the function is zero at non negative integers. We refine this theorem and describe not only the function's growth but also necessary and sufficient conditions in terms of its spectral measure.


Multistate Tuning of Third Harmonic Generation in Fano Resonant Hybrid Dielectric Metasurfaces. Hybrid dielectric metasurfaces have emerged as a promising approach to enhancing near field confinement and thus achieving high optical nonlinearity using low loss dielectrics. Additional flexibility in design and fabrication of hybrid metasurfaces allows dynamic control of light, which is value added for a wider range of applications. Here, we demonstrate a tunable and efficient third harmonic generation (THG) via hybrid metasurfaces with phase change material Ge2Sb2Te5 (GST) deposited on top of amorphous silicon nanostructutes. Fano resonance is excited to confine the incident light inside the hybrid metasurfaces, and an experimental quality factor ( Q factor) of 125 is achieved at the fundamental pump wavelength around 1210 nm. We demonstrate the switching between a turn on state of Fano resonance in the amorphous state of GST and a turn off state in its crystalline state and also gradual multistate tuning of THG emission at its intermediate state. We achieve a high THG conversion efficiency of eta 2.9 10 6 , which is more than 32 times of that of a GST based Fabry P erot cavity under a similar pump laser power, thanks to the enhanced field confinement due to the Fano resonance. Our results show the strong potential of GST based hybrid dielectric metasurfaces for efficient and tunable nonlinear optical devices.


Finite Volume Neural Network Modeling Subsurface Contaminant Transport. Data driven modeling of spatiotemporal physical processes with general deep learning methods is a highly challenging task. It is further exacerbated by the limited availability of data, leading to poor generalizations in standard neural network models. To tackle this issue, we introduce a new approach called the Finite Volume Neural Network (FINN). The FINN method adopts the numerical structure of the well known Finite Volume Method for handling partial differential equations, so that each quantity of interest follows its own adaptable conservation law, while it concurrently accommodates learnable parameters. As a result, FINN enables better handling of fluxes between control volumes and therefore proper treatment of different types of numerical boundary conditions. We demonstrate the effectiveness of our approach with a subsurface contaminant transport problem, which is governed by a non linear diffusion sorption process. FINN does not only generalize better to differing boundary conditions compared to other methods, it is also capable to explicitly extract and learn the constitutive relationships (expressed by the retardation factor). More importantly, FINN shows excellent generalization ability when applied to both synthetic datasets and real, sparse experimental data, thus underlining its relevance as a data driven modeling tool.


Quantitative straightening of distance spheres. We study "distance spheres" the set of points lying at constant distance from a fixed arbitrary subset K of 0,1 d . We show that, away from the regions where K is "too dense" and a set of small volume, we can decompose 0,1 d into a finite number of sets on which the distance spheres can be "straightened" into subsets of parallel (d 1) dimensional planes by a bi Lipschitz map. Importantly, the number of sets and the bi Lipschitz constants are independent of the set K .


Understanding and Improving Robustness of Vision Transformers through Patch based Negative Augmentation. We investigate the robustness of vision transformers (ViTs) through the lens of their special patch based architectural structure, i.e., they process an image as a sequence of image patches. We find that ViTs are surprisingly insensitive to patch based transformations, even when the transformation largely destroys the original semantics and makes the image unrecognizable by humans. This indicates that ViTs heavily use features that survived such transformations but are generally not indicative of the semantic class to humans. Further investigations show that these features are useful but non robust, as ViTs trained on them can achieve high in distribution accuracy, but break down under distribution shifts. From this understanding, we ask can training the model to rely less on these features improve ViT robustness and out of distribution performance? We use the images transformed with our patch based operations as negatively augmented views and offer losses to regularize the training away from using non robust features. This is a complementary view to existing research that mostly focuses on augmenting inputs with semantic preserving transformations to enforce models' invariance. We show that patch based negative augmentation consistently improves robustness of ViTs across a wide set of ImageNet based robustness benchmarks. Furthermore, we find our patch based negative augmentation are complementary to traditional (positive) data augmentation, and together boost the performance further. All the code in this work will be open sourced.


Hom weak omega categories of a weak omega category. Classical definitions of weak higher dimensional categories are given inductively for example, a bicategory has a set of objects and hom categories, and a tricategory has a set of objects and hom bicategories. However, more recent definitions of weak n categories for all natural numbers n , or of weak omega categories, take more sophisticated approaches, and the nature of the "hom" is often not immediate from the definitions. In this paper, we focus on Leinster's definition of weak omega category based on an earlier definition by Batanin, and construct for each weak omega category mathcal A , an underlying (weak omega category) enriched graph consisting of the same objects and for each pair of objects x and y , a hom weak omega category mathcal A (x,y) . We also show that our construction is functorial with respect to weak omega functors introduced by Garner.


Quantitative bounds for the U 4 inverse theorem over low characteristic finite fields. This paper gives the first quantitative bounds for the inverse theorem for the Gowers U 4 norm over mathbb F p n when p 2,3 . We build upon earlier work of Gowers and Mili 'cevi 'c who solved the corresponding problem for p geq 5 . Our proof has two main steps symmetrization and integration of low characteristic trilinear forms. We are able to solve the integration problem for all k linear forms, but the symmetrization problem we are only able to solve for trilinear forms. We pose several open problems about symmetrization of low characteristic k linear forms whose resolution, combined with recent work of Gowers and Mili 'cevi 'c, would give quantitative bounds for the inverse theorem for the Gowers U k 1 norm over mathbb F p n for all k,p .


Attention on Global Local Representation Spaces in Recommender Systems. In this study, we present a novel clustering based collaborative filtering (CF) method for recommender systems. Clustering based CF methods can effectively deal with data sparsity and scalability problems. However, most of them are applied to a single representation space, which might not characterize complex user item interactions well. We argue that the user item interactions should be observed from multiple views and characterized in an adaptive way. To address this issue, we leveraged the global and local properties to construct multiple representation spaces by learning various training datasets and loss functions. An attention network was built to generate a blended representation according to the relative importance of the representation spaces for each user item pair, providing a flexible way to characterize diverse user item interactions. Substantial experiments were evaluated on four popular benchmark datasets. The results show that the proposed method is superior to several CF methods where only one representation space is considered.


The Key Equation for One Point Codes. For Reed Solomon codes, the key equation relates the syndrome polynomial computed from the parity check matrix and the received vector to two unknown polynomials, the locator and the evaluator. The roots of the locator polynomial identify the error positions. The evaluator polynomial, along with the derivative of the locator polynomial, gives the error values via the Forney formula. The Berlekamp Massey algorithm efficiently computes the two unknown polynomials. This chapter shows how the key equation, the Berlekamp Massey algorithm, the Forney formula, and another formula for error evaluation due to Horiguchi all generalize in a natural way to one point codes. The algorithm presented here is based on K "otter's adaptation of Sakata's algorithm.


Energy Efficient Mobile Robot Control via Run time Monitoring of Environmental Complexity and Computing Workload. We propose an energy efficient controller to minimize the energy consumption of a mobile robot by dynamically manipulating the mechanical and computational actuators of the robot. The mobile robot performs real time vision based applications based on an event based camera. The actuators of the controller are CPU voltage frequency for the computation part and motor voltage for the mechanical part. We show that independently considering speed control of the robot and voltage frequency control of the CPU does not necessarily result in an energy efficient solution. In fact, to obtain the highest efficiency, the computation and mechanical parts should be controlled together in synergy. We propose a fast hill climbing optimization algorithm to allow the controller to find the best CPU motor configuration at run time and whenever the mobile robot is facing a new environment during its travel. Experimental results on a robot with Brushless DC Motors, Jetson TX2 board as the computing unit, and a DAVIS 346 event based camera show that the proposed control algorithm can save battery energy by an average of 50.5 , 41 , and 30 , in low complexity, medium complexity, and high complexity environments, over baselines.


Disentangling Syntax and Semantics in the Brain with Deep Networks. The activations of language transformers like GPT 2 have been shown to linearly map onto brain activity during speech comprehension. However, the nature of these activations remains largely unknown and presumably conflate distinct linguistic classes. Here, we propose a taxonomy to factorize the high dimensional activations of language models into four combinatorial classes lexical, compositional, syntactic, and semantic representations. We then introduce a statistical method to decompose, through the lens of GPT 2's activations, the brain activity of 345 subjects recorded with functional magnetic resonance imaging (fMRI) during the listening of 4.6 hours of narrated text. The results highlight two findings. First, compositional representations recruit a more widespread cortical network than lexical ones, and encompass the bilateral temporal, parietal and prefrontal cortices. Second, contrary to previous claims, syntax and semantics are not associated with separated modules, but, instead, appear to share a common and distributed neural substrate. Overall, this study introduces a versatile framework to isolate, in the brain activity, the distributed representations of linguistic constructs.


Modelling Neighbor Relation in Joint Space Time Graph for Video Correspondence Learning. This paper presents a self supervised method for learning reliable visual correspondence from unlabeled videos. We formulate the correspondence as finding paths in a joint space time graph, where nodes are grid patches sampled from frames, and are linked by two types of edges (i) neighbor relations that determine the aggregation strength from intra frame neighbors in space, and (ii) similarity relations that indicate the transition probability of inter frame paths across time. Leveraging the cycle consistency in videos, our contrastive learning objective discriminates dynamic objects from both their neighboring views and temporal views. Compared with prior works, our approach actively explores the neighbor relations of central instances to learn a latent association between center neighbor pairs (e.g., "hand arm") across time, thus improving the instance discrimination. Without fine tuning, our learned representation outperforms the state of the art self supervised methods on a variety of visual tasks including video object propagation, part propagation, and pose keypoint tracking. Our self supervised method also surpasses some fully supervised algorithms designed for the specific tasks.


The Weierstrass wp function of the hexagonal lattice. We present some properties of the Weierstrass wp function associated to the hexagonal (or triangular) lattice. In particular, with the help of an old theorem of I.N. Baker cite B on the characterization of meromorphic solutions of the equation X 3 Y 3 1 we determine the zeros of the function wp'(z) pm sqrt 3 .


A versatile flexure based 6 axes force torque sensor and its application to tribology. Six axes force torque sensors are increasingly needed in mechanical engineering. Here, we introduce a flexure based design for such sensors, which solves some of the drawbacks of the existing designs. In particular, it is backlash free, it can be wirelessly monitored, it exactly enforces 90 degrees angles between axes, and it enables visual inspection of the monitored system thanks to its hollow structure. We first describe the generic design, implementation and calibration procedure. We then demonstrate its capabilities through three illustration examples relevant to the field of tribology low friction measurements under ultra high vacuum, multi directional friction measurements of elastomer contacts, and force torque based contact position monitoring.


Topology Inference of Networks utilizing Rooted Spanning Tree Embeddings. Due to its high efficiency, routing based on greedy embeddings of rooted spanning trees is a promising approach for dynamic, large scale networks with restricted topologies. Friend to friend (F2F) overlays, one key application of embedding based routing, aim to prevent disclosure of their participants to malicious members by restricting exchange of messages to mutually trusted nodes. Since embeddings assign a unique integer vector to each node that encodes its position in a spanning tree of the overlay, attackers can infer network structure from knowledge about assigned vectors. As this information can be used to identify participants, an evaluation of the scale of leakage is needed. In this work, we analyze in detail which information malicious participants can infer from knowledge about assigned vectors. Also, we show that by monitoring packet trajectories, malicious participants cannot unambiguously infer links between nodes of unidentified participants. Using simulation, we find that the vector assignment procedure has a strong impact on the feasibility of inference. In F2F overlay networks, using vectors of randomly chosen numbers for routing decreases the mean number of discovered individuals by one order of magnitude compared to the popular approach of using child enumeration indexes as vector elements.


Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Features. Deepfakes is a branch of malicious techniques that transplant a target face to the original one in videos, resulting in serious problems such as infringement of copyright, confusion of information, or even public panic. Previous efforts for Deepfakes videos detection mainly focused on appearance features, which have a risk of being bypassed by sophisticated manipulation, also resulting in high model complexity and sensitiveness to noise. Besides, how to mine the temporal features of manipulated videos and exploit them is still an open question. We propose an efficient and robust framework named LRNet for detecting Deepfakes videos through temporal modeling on precise geometric features. A novel calibration module is devised to enhance the precision of geometric features, making it more discriminative, and a two stream Recurrent Neural Network (RNN) is constructed for sufficient exploitation of temporal features. Compared to previous methods, our proposed method is lighter weighted and easier to train. Moreover, our method has shown robustness in detecting highly compressed or noise corrupted videos. Our model achieved 0.999 AUC on FaceForensics dataset. Meanwhile, it has a graceful decline in performance ( 0.042 AUC) when faced with highly compressed videos.


Learning Bermudans. American and Bermudan type financial instruments are often priced with specific Monte Carlo techniques whose efficiency critically depends on the effective dimensionality of the problem and the available computational power. In our work we focus on Bermudan Swaptions, well known interest rate derivatives embedded in callable debt instruments or traded in the OTC market for hedging or speculation purposes, and we adopt an original pricing approach based on Supervised Learning (SL) algorithms. In particular, we link the price of a Bermudan Swaption to its natural hedges, i.e. the underlying European Swaptions, and other sound financial quantities through SL non parametric regressions. We test different algorithms, from linear models to decision tree based models and Artificial Neural Networks (ANN), analyzing their predictive performances. All the SL algorithms result to be reliable and fast, allowing to overcome the computational bottleneck of standard Monte Carlo simulations the best performing algorithms for our problem result to be Ridge, ANN and Gradient Boosted Regression Tree. Moreover, using feature importance techniques, we are able to rank the most important driving factors of a Bermudan Swaption price, confirming that the value of the maximum underlying European Swaption is the prevailing feature.


The Accuracy and Efficiency of Posit Arithmetic. Motivated by the increasing interest in the posit numeric format, in this paper we evaluate the accuracy and efficiency of posit arithmetic in contrast to the traditional IEEE 754 32 bit floating point (FP32) arithmetic. We first design and implement a Posit Arithmetic Unit (PAU), called POSAR, with flexible bit sized arithmetic suitable for applications that can trade accuracy for savings in chip area. Next, we analyze the accuracy and efficiency of POSAR with a series of benchmarks including mathematical computations, ML kernels, NAS Parallel Benchmarks (NPB), and Cifar 10 CNN. This analysis is done on our implementation of POSAR integrated into a RISC V Rocket Chip core in comparison with the IEEE 754 based Floting Point Unit (FPU) of Rocket Chip. Our analysis shows that POSAR can outperform the FPU, but the results are not spectacular. For NPB, 32 bit posit achieves better accuracy than FP32 and improves the execution by up to 2 . However, POSAR with 32 bit posit needs 30 more FPGA resources compared to the FPU. For classic ML algorithms, we find that 8 bit posits are not suitable to replace FP32 because they exhibit low accuracy leading to wrong results. Instead, 16 bit posit offers the best option in terms of accuracy and efficiency. For example, 16 bit posit achieves the same Top 1 accuracy as FP32 on a Cifar 10 CNN with a speedup of 18 .


Expertise Affects Drone Racing Performance. First person view drone racing has become a popular televised sport. However, very little is known about the perceptual and motor skills of professional drone racing pilots. A better understanding of these skills may inform path planning and control algorithms for autonomous multirotor flight. By using a real world drone racing track and a large scale position tracking system, we compare the drone racing performance of five professional and five beginner pilots. Results show that professional pilots consistently outperform beginner pilots by achieving faster lap times, higher velocity, and more efficiently executing the challenging maneuvers. Trajectory analysis shows that experienced pilots choose more optimal racing lines than beginner pilots. Our results provide strong evidence for a contribution of expertise to performances in real world human piloted drone racing. We discuss the implications of these results for future work on autonomous fast and agile flight. We make our data openly available.


Solutions to the non cutoff Boltzmann equation uniformly near a Maxwellian. The purpose of this paper is to show how the combination of the well known results for convergence to equilibrium and conditional regularity, in addition to a short time existence result, lead to a quick proof of the existence of global smooth solutions for the non cutoff Boltzmann equation when the initial data is close to equilibrium. We include a short time existence result for polynomially weighted L infty initial data. From this, we deduce that if the initial data is sufficiently close to a Maxwellian in this norm, then a smooth solution exists globally in time.


Sports Video Fine Grained Action Detection and Classification of Table Tennis Strokes from Videos for MediaEval 2021. Sports video analysis is a prevalent research topic due to the variety of application areas, ranging from multimedia intelligent devices with user tailored digests up to analysis of athletes' performance. The Sports Video task is part of the MediaEval 2021 benchmark. This task tackles fine grained action detection and classification from videos. The focus is on recordings of table tennis games. Running since 2019, the task has offered a classification challenge from untrimmed video recorded in natural conditions with known temporal boundaries for each stroke. This year, the dataset is extended and offers, in addition, a detection challenge from untrimmed videos without annotations. This work aims at creating tools for sports coaches and players in order to analyze sports performance. Movement analysis and player profiling may be built upon such technology to enrich the training experience of athletes and improve their performance.


GarNet A Continuous Robot Vision Approach for Predicting Shapes and Visually Perceived Weights of Garments. We present a Garment Similarity Network (GarNet) that learns geometric and physical similarities between known garments by continuously observing a garment while a robot picks it up from a table. The aim is to capture and encode geometric and physical characteristics of a garment into a manifold where a decision can be carried out, such as predicting the garment's shape class and its visually perceived weight. Our approach features an early stop strategy, which means that GarNet does not need to observe a garment being picked up from a crumpled to a hanging state to make a prediction. In our experiments, we find that GarNet achieves prediction accuracies of 92 for shape classification and 95.5 for predicting weights and advances state of art approaches by 21 for shape classification.


Shuffle Private Stochastic Convex Optimization. In shuffle privacy, each user sends a collection of randomized messages to a trusted shuffler, the shuffler randomly permutes these messages, and the resulting shuffled collection of messages must satisfy differential privacy. Prior work in this model has largely focused on protocols that use a single round of communication to compute algorithmic primitives like means, histograms, and counts. We present interactive shuffle protocols for stochastic convex optimization. Our protocols rely on a new noninteractive protocol for summing vectors of bounded ell 2 norm. By combining this sum subroutine with mini batch stochastic gradient descent, accelerated gradient descent, and Nesterov's smoothing method, we obtain loss guarantees for a variety of convex loss functions that significantly improve on those of the local model and sometimes match those of the central model.


Neural ranking models for document retrieval. Ranking models are the main components of information retrieval systems. Several approaches to ranking are based on traditional machine learning algorithms using a set of hand crafted features. Recently, researchers have leveraged deep learning models in information retrieval. These models are trained end to end to extract features from the raw data for ranking tasks, so that they overcome the limitations of hand crafted features. A variety of deep learning models have been proposed, and each model presents a set of neural network components to extract features that are used for ranking. In this paper, we compare the proposed models in the literature along different dimensions in order to understand the major contributions and limitations of each model. In our discussion of the literature, we analyze the promising neural components, and propose future research directions. We also show the analogy between document retrieval and other retrieval tasks where the items to be ranked are structured documents, answers, images and videos.


A syntactic approach to Shelah's logic L 1 kappa . In 2012 Shelah defined a new infinitary logic L 1 kappa . We provide here an alternative approach to this logic, by defining a new logic L 1,c kappa , smaller than L 1 kappa , whose closure under the Delta operator is L 1 kappa and which has a clearly defined, recursive syntax. We prove that it also satisfies a union lemma and the undefinability of well order. We study its L "owenheim Skolem Tarski spectrum, its expressive power, and its model theoretic potential. We provide a general proof of undefinability of well order, in the context of abstract logics.


Interpretation of Plug and Play (PnP) algorithms from a different angle. It's well known that inverse problems are ill posed and to solve them meaningfully one has to employ regularization methods. Traditionally, the most popular regularization approaches are Variational type approaches, i.e., penalized constrained functional minimization. In recent years, the classical regularization approaches have been replaced by the so called plug and play (PnP) algorithms, which copies the proximal gradient minimization processes, such as ADMM or FISTA, but with any general denoiser. However, unlike the traditional proximal gradient methods, the theoretical analysis and convergence results have been insufficient for these PnP algorithms. Hence, the results from these algorithms, though empirically outstanding, are not well defined, in the sense of, being a minimizer of a Variational problem. In this paper, we address this question of "well definedness", but from a different angle. We explain these algorithms from the viewpoint of a semi iterative regularization method. In addition, we expand the family of regularized solutions, corresponding to the classical semi iterative methods, to further generalize the explainability of these algorithms, as well as, enhance the recovery process. We conclude with several numerical results which validate the developed theories and reflect the improvements over the traditional PnP algorithms, such as ADMM PnP and FISTA PnP.


Local Mutual Exclusion for Dynamic, Anonymous, Bounded Memory Message Passing Systems. Mutual exclusion is a classical problem in distributed computing that provides isolation among concurrent action executions that may require access to the same shared resources. Inspired by algorithmic research on distributed systems of weakly capable entities whose connections change over time, we address the local mutual exclusion problem that tasks each node with acquiring exclusive locks for itself and the maximal subset of its "persistent" neighbors that remain connected to it over the time interval of the lock request. Using the established time varying graphs model to capture adversarial topological changes, we propose and rigorously analyze a local mutual exclusion algorithm for nodes that are anonymous and communicate via asynchronous message passing. The algorithm satisfies mutual exclusion (non intersecting lock sets) and lockout freedom (eventual success with probability 1) under both semi synchronous and asynchronous concurrency. It requires mathcal O ( Delta) memory per node and messages of size Theta(1) , where Delta is the maximum number of connections per node. We conclude by describing how our algorithm can implement the pairwise interactions assumed by population protocols and the concurrency control operations assumed by the canonical amoebot model, demonstrating its utility in both passively and actively dynamic distributed systems.


AutoLoss Automated Loss Function Search in Recommendations. Designing an effective loss function plays a crucial role in training deep recommender systems. Most existing works often leverage a predefined and fixed loss function that could lead to suboptimal recommendation quality and training efficiency. Some recent efforts rely on exhaustively or manually searched weights to fuse a group of candidate loss functions, which is exceptionally costly in computation and time. They also neglect the various convergence behaviors of different data examples. In this work, we propose an AutoLoss framework that can automatically and adaptively search for the appropriate loss function from a set of candidates. To be specific, we develop a novel controller network, which can dynamically adjust the loss probabilities in a differentiable manner. Unlike existing algorithms, the proposed controller can adaptively generate the loss probabilities for different data examples according to their varied convergence behaviors. Such design improves the model's generalizability and transferability between deep recommender systems and datasets. We evaluate the proposed framework on two benchmark datasets. The results show that AutoLoss outperforms representative baselines. Further experiments have been conducted to deepen our understandings of AutoLoss, including its transferability, components and training efficiency.