OOWL500 Overcoming Dataset Collection Bias in the Wild. The hypothesis that image datasets gathered online "in the wild" can produce biased object recognizers, e.g. preferring professional photography or certain viewing angles, is studied. A new "in the lab" data collection infrastructure is proposed consisting of a drone which captures images as it circles around objects. Crucially, the control provided by this setup and the natural camera shake inherent to flight mitigate many biases. It's inexpensive and easily replicable nature may also potentially lead to a scalable data collection effort by the vision community. The procedure's usefulness is demonstrated by creating a dataset of Objects Obtained With fLight (OOWL). Denoted as OOWL500, it contains 120,000 images of 500 objects and is the largest "in the lab" image dataset available when both number of classes and objects per class are considered. Furthermore, it has enabled several of new insights on object recognition. First, a novel adversarial attack strategy is proposed, where image perturbations are defined in terms of semantic properties such as camera shake and pose. Indeed, experiments have shown that ImageNet has considerable amounts of pose and professional photography bias. Second, it is used to show that the augmentation of in the wild datasets, such as ImageNet, with in the lab data, such as OOWL500, can significantly decrease these biases, leading to object recognizers of improved generalization. Third, the dataset is used to study questions on "best procedures" for dataset collection. It is revealed that data augmentation with synthetic images does not suffice to eliminate in the wild datasets biases, and that camera shake and pose diversity play a more important role in object recognition robustness than previously thought.


IDEAL Independent Domain Embedding Augmentation Learning. Many efforts have been devoted to designing sampling, mining, and weighting strategies in high level deep metric learning (DML) loss objectives. However, little attention has been paid to low level but essential data transformation. In this paper, we develop a novel mechanism, the independent domain embedding augmentation learning ( IDEAL ) method. It can simultaneously learn multiple independent embedding spaces for multiple domains generated by predefined data transformations. Our IDEAL is orthogonal to existing DML techniques and can be seamlessly combined with prior DML approaches for enhanced performance. Empirical results on visual retrieval tasks demonstrate the superiority of the proposed method. For example, the IDEAL improves the performance of MS loss by a large margin, 84.5 rightarrow 87.1 on Cars 196, and 65.8 rightarrow 69.5 on CUB 200 at Recall 1 . Our IDEAL with MS loss also achieves the new state of the art performance on three image retrieval benchmarks, ie, emph Cars 196 , emph CUB 200 , and emph SOP . It outperforms the most recent DML approaches, such as Circle loss and XBM, significantly. The source code and pre trained models of our method will be available at emph url https github.com emdata ailab IDEAL .


Cross interactive residual smoothing for global and block Lanczos type solvers for linear systems with multiple right hand sides. Global and block Krylov subspace methods are efficient iterative solvers for large sparse linear systems with multiple right hand sides. However, global or block Lanczos type solvers often exhibit large oscillations in the residual norms and may have a large residual gap relating to the loss of attainable accuracy of the approximations. Conventional residual smoothing schemes suppress these oscillations but cannot improve the attainable accuracy, whereas a recent residual smoothing scheme enables the improvement of the attainable accuracy for single right hand side Lanczos type solvers. The underlying concept of this scheme is that the primary and smoothed sequences of the approximations and residuals influence one another, thereby avoiding the severe propagation of rounding errors. In the present study, we extend this cross interactive residual smoothing to the case of solving linear systems with multiple right hand sides. The resulting smoothed methods can reduce the residual gap with a low additional cost compared to their original counterparts. We demonstrate the effectiveness of the proposed approach through rounding error analysis and numerical experiments.


Deriving Laws for Developing Concurrent Programs in a Rely Guarantee Style. In this paper we present a theory for the refinement of shared memory concurrent algorithms from specifications. Our approach avoids restrictive atomicity contraints. It provides a range of constructs for specifying concurrent programs and laws for refining these to code. We augment pre and post condition specifications with Jones' rely and guarantee conditions, which we encode as commands within a wide spectrum language. Program components are specified using either partial and total correctness versions of end to end specifications. Operations on shared data structures and atomic machine operations (e.g. compare and swap) are specified using an atomic specification command. All the above constructs are defined in terms of a simple core language, based on four primitive commands and a handful of operators, and for which we have developed an extensive algebraic theory in Isabelle HOL. For shared memory programs, expression evaluation is subject to fine grained interference and we have avoided atomicity restrictions other than for read and write of primitive types (words). Expression evaluation and assignment commands are also defined in terms of our core language primitives, allowing laws for reasoning about them to be proven in the theory. Control structures such as conditionals, recursion and loops are all defined in terms of the core language. In developing the laws for refining to such structures from specifications we have taken care to develop laws that are as general as possible our laws are typically more general than those found in the literature. In developing our concurrent refinement theory we have taken care to focus on the algebraic properties of our commands and operators, which has allowed us to reuse algebraic theories, including well known theories, such as lattices and boolean algebra, as well as programming specific algebras, such as our synchronous algebra.


On the derivation of guiding center dynamics without coordinate dependence. The application of conventional guiding center theory is obstructed by the global existence problem of coordinates. A general coordinate independent geometric representation of the guiding center theory is developed, which clearly defined the procedure for the gyro averaging and the Lie perturbation without special coordinates introduced. The unperturbed Poincar 'e Cartan Einstein one form is calculated to the second order without coordinates dependent. To solve the obsession caused by the conventional guiding center coordinates, a the Cartesian coordinates implementation of guiding center dynamics is presented.


Query2Label A Simple Transformer Way to Multi Label Classification. This paper presents a simple and effective approach to solving the multi label classification problem. The proposed approach leverages Transformer decoders to query the existence of a class label. The use of Transformer is rooted in the need of extracting local discriminative features adaptively for different labels, which is a strongly desired property due to the existence of multiple objects in one image. The built in cross attention module in the Transformer decoder offers an effective way to use label embeddings as queries to probe and pool class related features from a feature map computed by a vision backbone for subsequent binary classifications. Compared with prior works, the new framework is simple, using standard Transformers and vision backbones, and effective, consistently outperforming all previous works on five multi label classification data sets, including MS COCO, PASCAL VOC, NUS WIDE, and Visual Genome. Particularly, we establish 91.3 mAP on MS COCO. We hope its compact structure, simple implementation, and superior performance serve as a strong baseline for multi label classification tasks and future studies. The code will be available soon at https github.com SlongLiu query2labels.


Incremental Learning of Probabilistic Movement Primitives (ProMPs) for Human Robot Cooperation. For a successful deployment of physical Human Robot Cooperation (pHRC), humans need to be able to teach robots new motor skills quickly. Probabilistic movement primitives (ProMPs) are a promising method to encode a robot's motor skills learned from human demonstrations in pHRC settings. However, most algorithms to learn ProMPs from human demonstrations operate in batch mode, which is not ideal in pHRC. In this paper we propose a new learning algorithm to learn ProMPs incrementally in pHRC settings. Our algorithm incorporates new demonstrations sequentially as they arrive, allowing humans to observe the robot's learning progress and incrementally shape the robot's motor skill. A built in forgetting factor allows for corrective demonstrations resulting from the human's learning curve or changes in task constraints. We compare the performance of our algorithm to existing batch ProMP algorithms on reference data generated from a pick and place task at our lab. Furthermore, we show in a proof of concept study on a Franka Emika Panda how the forgetting factor allows us to adopt changes in the task. The incremental learning algorithm presented in this paper has the potential to lead to a more intuitive learning progress and to establish a successful cooperation between human and robot faster than training in batch mode.


Perceptions of Fairness and Trustworthiness Based on Explanations in Human vs. Automated Decision Making. Automated decision systems (ADS) have become ubiquitous in many high stakes domains. Those systems typically involve sophisticated yet opaque artificial intelligence (AI) techniques that seldom allow for full comprehension of their inner workings, particularly for affected individuals. As a result, ADS are prone to deficient oversight and calibration, which can lead to undesirable (e.g., unfair) outcomes. In this work, we conduct an online study with 200 participants to examine people's perceptions of fairness and trustworthiness towards ADS in comparison to a scenario where a human instead of an ADS makes a high stakes decision and we provide thorough identical explanations regarding decisions in both cases. Surprisingly, we find that people perceive ADS as fairer than human decision makers. Our analyses also suggest that people's AI literacy affects their perceptions, indicating that people with higher AI literacy favor ADS more strongly over human decision makers, whereas low AI literacy people exhibit no significant differences in their perceptions.


Learning to Reweight Imaginary Transitions for Model Based Reinforcement Learning. Model based reinforcement learning (RL) is more sample efficient than model free RL by using imaginary trajectories generated by the learned dynamics model. When the model is inaccurate or biased, imaginary trajectories may be deleterious for training the action value and policy functions. To alleviate such problem, this paper proposes to adaptively reweight the imaginary transitions, so as to reduce the negative effects of poorly generated trajectories. More specifically, we evaluate the effect of an imaginary transition by calculating the change of the loss computed on the real samples when we use the transition to train the action value and policy functions. Based on this evaluation criterion, we construct the idea of reweighting each imaginary transition by a well designed meta gradient algorithm. Extensive experimental results demonstrate that our method outperforms state of the art model based and model free RL algorithms on multiple tasks. Visualization of our changing weights further validates the necessity of utilizing reweight scheme.


ID Unet Iterative Soft and Hard Deformation for View Synthesis. View synthesis is usually done by an autoencoder, in which the encoder maps a source view image into a latent content code, and the decoder transforms it into a target view image according to the condition. However, the source contents are often not well kept in this setting, which leads to unnecessary changes during the view translation. Although adding skipped connections, like Unet, alleviates the problem, but it often causes the failure on the view conformity. This paper proposes a new architecture by performing the source to target deformation in an iterative way. Instead of simply incorporating the features from multiple layers of the encoder, we design soft and hard deformation modules, which warp the encoder features to the target view at different resolutions, and give results to the decoder to complement the details. Particularly, the current warping flow is not only used to align the feature of the same resolution, but also as an approximation to coarsely deform the high resolution feature. Then the residual flow is estimated and applied in the high resolution, so that the deformation is built up in the coarse to fine fashion. To better constrain the model, we synthesize a rough target view image based on the intermediate flows and their warped features. The extensive ablation studies and the final results on two different data sets show the effectiveness of the proposed model.


Comparative Analysis for Quick Sort Algorithm under four Different Modes of Execution. This work presents a comparison for the performance of sequential sorting algorithms under four different modes of execution, the sequential processing mode, a conventional multi threading implementation, multi threading with OpenMP Library and finally parallel processing on a super computer. Quick Sort algorithm was selected to run the experiments performed by this effort and the algorithm was run using different arrays sizes and different number of processors. The results and findings were analyzed uncovering limitations as well as enhancement potentials of sequential sorting algorithms using parallelism.


A Simple Geometric Method for Cross Lingual Linguistic Transformations with Pre trained Autoencoders. Powerful sentence encoders trained for multiple languages are on the rise. These systems are capable of embedding a wide range of linguistic properties into vector representations. While explicit probing tasks can be used to verify the presence of specific linguistic properties, it is unclear whether the vector representations can be manipulated to indirectly steer such properties. For efficient learning, we investigate the use of a geometric mapping in embedding space to transform linguistic properties, without any tuning of the pre trained sentence encoder or decoder. We validate our approach on three linguistic properties using a pre trained multilingual autoencoder and analyze the results in both monolingual and cross lingual settings.


Study of a fractional stochastic heat equation. In this article, we study a d dimensional stochastic nonlinear heat equation (SNLH) with a quadratic nonlinearity, forced by a fractional space time white noise begin equation left begin array l partial t u Delta u rho 2 u 2 dot B , , quad t in 0,T , , , x in mathbb R d , , u 0 phi , . end array right. end equation Two types of regimes are exhibited, depending on the ranges of the Hurst index H (H 0,...,H d) in (0,1) d 1 . In particular, we show that the local well posedness of (SNLH) resulting from the Da Prato Debussche trick, is easily obtained when 2 H 0 sum i 1 d H i d . On the contrary, (SNLH) is much more difficult to handle when 2H 0 sum i 1 d H i leq d . In this case, the model has to be interpreted in the Wick sense, thanks to a time dependent renormalization. Helped with the regularising effect of the heat semigroup, we establish local well posedness results for (SNLH) for all dimension d geq1.


Commissioning of a clinical pencil beam scanning proton therapy unit for ultrahigh dose rates (FLASH). Purpose The purpose of this work was to provide a flexible platform for FLASH research with protons by adapting a former clinical pencil beam scanning gantry to irradiations with ultrahigh dose rates. Methods PSI Gantry 1 treated patients until December 2018. We optimized the beamline parameters to transport the 250 MeV beam extracted from the PSI COMET accelerator to the treatment room, maximizing the transmission of beam intensity to the sample. We characterized a dose monitor on the gantry to ensure good control of the dose, delivered in spot scanning mode. We characterized the beam for different dose rates and field sizes for transmission irradiations. We explored scanning possibilities in order to enable conformal irradiations or transmission irradiations of large targets (with transverse scanning). Results We achieved a transmission of 86 from the cyclotron to the treatment room. We reached a peak dose rate of 9000 Gy s at 3 mm water equivalent depth, along the central axis of a single pencil beam. Field sizes of up to 5x5 mm 2 were achieved for single spot FLASH irradiations. Fast transverse scanning allowed to cover a field of 16x1.2 cm 2 . With the use of a nozzle mounted range shifter we are able to span depths in water ranging from 19.6 to 37.9 cm. Various dose levels were delivered with a precision within less than 1 . Conclusions We have realized a proton FLASH irradiation setup able to investigate continuously a wide dose rate spectrum, from 1 to 9000 Gy s in a single spot irradiation as well as in the pencil beam scanning mode. As such, we have developed a versatile test bench for FLASH research.


CovarianceNet Conditional Generative Model for Correct Covariance Prediction in Human Motion Prediction. The correct characterization of uncertainty when predicting human motion is equally important as the accuracy of this prediction. We present a new method to correctly predict the uncertainty associated with the predicted distribution of future trajectories. Our approach, CovariaceNet, is based on a Conditional Generative Model with Gaussian latent variables in order to predict the parameters of a bi variate Gaussian distribution. The combination of CovarianceNet with a motion prediction model results in a hybrid approach that outputs a uni modal distribution. We will show how some state of the art methods in motion prediction become overconfident when predicting uncertainty, according to our proposed metric and validated in the ETH data set cite pellegrini2009you . CovarianceNet correctly predicts uncertainty, which makes our method suitable for applications that use predicted distributions, e.g., planning or decision making.


Urban Building Energy Modeling (UBEM) Tools A State of the Art Review of bottom up physics based approaches. Regulations corroborate the importance of retrofitting existing building stocks or constructing new energy efficient district. There is, thus, a need for modeling tools to evaluate energy scenarios to better manage and design cities, and numerous methodologies and tools have been developed. Among them, Urban Building Energy Modeling (UBEM) tools allow the energy simulation of buildings at large scales. Choosing an appropriate UBEM tool, balancing the level of complexity, accuracy, usability, and computing needs, remains a challenge for users. The review focuses on the main bottom up physics based UBEM tools, comparing them from a user oriented perspective. Five categories are used (i) the required inputs, (ii) the reported outputs, (iii) the exploited workflow, (iv) the applicability of each tool, and (v) the potential users. Moreover, a critical discussion is proposed focusing on interests and trends in research and development. The results highlighted major differences between UBEM tools that must be considered to choose the proper one for an application. Barriers of adoption of UBEM tools include the needs of a standardized ontology, a common three dimensional city model, a standard procedure to collect data, and a standard set of test cases. This feeds into future development of UBEM tools to support cities' sustainability goals.


Well posedness for the incompressible Hall MHD system with initial magnetic field belonging to H frac 3 2 ( mathbb R 3) . In this paper, we first prove the local well posedness of strong solutions to the incompressible Hall MHD system with initial data (u 0,B 0) in H frac 1 2 sigma ( mathbb R 3) times H frac 3 2 ( mathbb R 3) and sigma in (0,2) . In particular, if the viscosity coefficient is equal to the resistivity coefficient, we can reduce sigma to 0 with the aid of the new formulation of the Hall MHD system observed by cite MR4193644 . Moreover, we establish the global well posedness in H frac 1 2 sigma ( mathbb R 3) times H frac 3 2 ( mathbb R 3) with sigma in (0,2) for small initial data and get the optimal time decay rates of solutions. Our results improves some previous works.


PWG IDS An Intrusion Detection Model for Solving Class Imbalance in IIoT Networks Using Generative Adversarial Networks. With the continuous development of industrial IoT (IIoT) technology, network security is becoming more and more important. And intrusion detection is an important part of its security. However, since the amount of attack traffic is very small compared to normal traffic, this imbalance makes intrusion detection in it very difficult. To address this imbalance, an intrusion detection system called pretraining Wasserstein generative adversarial network intrusion detection system (PWG IDS) is proposed in this paper. This system is divided into two main modules 1) In this module, we introduce the pretraining mechanism in the Wasserstein generative adversarial network with gradient penalty (WGAN GP) for the first time, firstly using the normal network traffic to train the WGAN GP, and then inputting the imbalance data into the pre trained WGAN GP to retrain and generate the final required data. 2) Intrusion detection module We use LightGBM as the classification algorithm to detect attack traffic in IIoT networks. The experimental results show that our proposed PWG IDS outperforms other models, with F1 scores of 99 and 89 on the 2 datasets, respectively. And the pretraining mechanism we proposed can also be widely used in other GANs, providing a new way of thinking for the training of GANs.


Semiclassical Lindblad master equation for spin dynamics. We derive the semi classical Lindblad master equation in phase space for both canonical and non canonical Poisson brackets using the Wigner Moyal formalism and the Moyal star product. The semi classical limit for canonical dynamical variables, i.e., canonical Poisson brackets, is the Fokker Planck equation, as derived before. We generalize this limit and show that it holds also for non canonical Poisson brackets. Examples are gyro Poisson brackets, which occur in spin ensembles, systems of recent interest in atomic physics and quantum optics. We show that the equations of motion for the collective spin variables are given by the Bloch equations of nuclear magnetization with relaxation. The Bloch and relaxation vectors are expressed in terms of the microscopic operators The Hamiltonian and the Lindblad functions in the Wigner Moyal formalism.


Hardware Acceleration of Explainable Machine Learning using Tensor Processing Units. Machine learning (ML) is successful in achieving human level performance in various fields. However, it lacks the ability to explain an outcome due to its black box nature. While existing explainable ML is promising, almost all of these methods focus on formatting interpretability as an optimization problem. Such a mapping leads to numerous iterations of time consuming complex computations, which limits their applicability in real time applications. In this paper, we propose a novel framework for accelerating explainable ML using Tensor Processing Units (TPUs). The proposed framework exploits the synergy between matrix convolution and Fourier transform, and takes full advantage of TPU's natural ability in accelerating matrix computations. Specifically, this paper makes three important contributions. (1) To the best of our knowledge, our proposed work is the first attempt in enabling hardware acceleration of explainable ML using TPUs. (2) Our proposed approach is applicable across a wide variety of ML algorithms, and effective utilization of TPU based acceleration can lead to real time outcome interpretation. (3) Extensive experimental results demonstrate that our proposed approach can provide an order of magnitude speedup in both classification time (25x on average) and interpretation time (13x on average) compared to state of the art techniques.


The Colombian Scientific Elite Science Mapping and Bibliometric Outlook. A well established agenda on the research output, impact, and structure of global scientific elites such as Nobel Prize laureates has generated interest in the scientific elites from developing countries. This study deploys science mapping techniques to provide a comprehensive analysis of the output, impact, and structure of the Colombian scientific elite, i.e., researchers awarded with the Alejandro Angel Escobar Foundation National Prize 1990 2020, known locally as the Colombian Nobel. Findings showed that the Colombian scientific elite has a broader agenda than indexing titles in internationally renowned bibliographic databases. The Colombian scientific elite also showed positive growth, which is an inverse trend compared with Nobel laureate productivity. There were no noticeable changes in productivity and impact before and after receiving the prize. Institutional collaboration within the Colombian scientific elite displayed the highest betweenness (brokerage) role of world and local top tier universities. However, only two Colombian scientific elite members published an article with two Nobel Prize laureates. Most of the research profiles reflected the national output priorities, but were found to diverge from the national focus in respect of strategic research capacities. This study also conducted a productivity and impact comparison with Nobel Prize laureates in science and economics by means of a stratified random sample 1990 2020 via the composite indicator proposed by Ioannidis et al. The interleaving of the Colombian scientific elite and Nobel Prize laureates, particularly between the 3rd and 2nd quartiles, enabled a more nuanced analysis of the local impact in the global scientific landscape.


Semi supervised Semantic Segmentation with Directional Context aware Consistency. Semantic segmentation has made tremendous progress in recent years. However, satisfying performance highly depends on a large number of pixel level annotations. Therefore, in this paper, we focus on the semi supervised segmentation problem where only a small set of labeled data is provided with a much larger collection of totally unlabeled images. Nevertheless, due to the limited annotations, models may overly rely on the contexts available in the training data, which causes poor generalization to the scenes unseen before. A preferred high level representation should capture the contextual information while not losing self awareness. Therefore, we propose to maintain the context aware consistency between features of the same identity but with different contexts, making the representations robust to the varying environments. Moreover, we present the Directional Contrastive Loss (DC Loss) to accomplish the consistency in a pixel to pixel manner, only requiring the feature with lower quality to be aligned towards its counterpart. In addition, to avoid the false negative samples and filter the uncertain positive samples, we put forward two sampling strategies. Extensive experiments show that our simple yet effective method surpasses current state of the art methods by a large margin and also generalizes well with extra image level annotations.


Lyapunov Barrier Policy Optimization. Deploying Reinforcement Learning (RL) agents in the real world require that the agents satisfy safety constraints. Current RL agents explore the environment without considering these constraints, which can lead to damage to the hardware or even other agents in the environment. We propose a new method, LBPO, that uses a Lyapunov based barrier function to restrict the policy update to a safe set for each training iteration. Our method also allows the user to control the conservativeness of the agent with respect to the constraints in the environment. LBPO significantly outperforms state of the art baselines in terms of the number of constraint violations during training while being competitive in terms of performance. Further, our analysis reveals that baselines like CPO and SDDPG rely mostly on backtracking to ensure safety rather than safe projection, which provides insight into why previous methods might not have effectively limit the number of constraint violations.


Are We Ready for Unmanned Surface Vehicles in Inland Waterways? The USVInland Multisensor Dataset and Benchmark. Unmanned surface vehicles (USVs) have great value with their ability to execute hazardous and time consuming missions over water surfaces. Recently, USVs for inland waterways have attracted increasing attention for their potential application in autonomous monitoring, transportation, and cleaning. However, unlike sailing in open water, the challenges posed by scenes of inland waterways, such as the complex distribution of obstacles, the global positioning system (GPS) signal denial environment, the reflection of bank side structures, and the fog over the water surface, all impede USV application in inland waterways. To address these problems and stimulate relevant research, we introduce USVInland, a multisensor dataset for USVs in inland waterways. The collection of USVInland spans a trajectory of more than 26 km in diverse real world scenes of inland waterways using various modalities, including lidar, stereo cameras, millimeter wave radar, GPS, and inertial measurement units (IMUs). Based on the requirements and challenges in the perception and navigation of USVs for inland waterways, we build benchmarks for simultaneous localization and mapping (SLAM), stereo matching, and water segmentation. We evaluate common algorithms for the above tasks to determine the influence of unique inland waterway scenes on algorithm performance. Our dataset and the development tools are available online at https www.orca tech.cn datasets.html.


On the similarities between Control Barrier Functions (CBFs) and Behavior Control Lyapunov Functions (BCLFs). Control Barrier Functions (CBFs) is an important tool used to address situations with multiple concurrent control objectives, such as safety and goal convergence. In this paper we investigate the similarities between CBFs and so called Behavior Control Lyapunov Functions (BCLFs) that have been proposed to address the same type of problems in the aeronautics domain. The key results of both CBFs and BCLFs is the description of the set of controls that render a given set invariant. We compare the corresponding theorems, and show that if we restrict the general class K function in CBFs to be the general linear function of BCLFs, and restrict the number of objectives as well as the number of priority levels to be just one in BCLFs, the results in terms of admissible control sets are equivalent. Furthermore, both papers show that the invariant set is made asymptotically stable.


Seshadri constants and K stability of Fano manifolds. We give a lower bound of the delta invariants of ample line bundles in terms of Seshadri constants. As applications, we prove the uniform K stability of infinitely many families of Fano hypersurfaces of arbitrarily large index, as well as the uniform K stability of most families of smooth Fano threefolds of Picard number one.


Answering Product Questions by Utilizing Questions from Other Contextually Similar Products. Predicting the answer to a product related question is an emerging field of research that recently attracted a lot of attention. Answering subjective and opinion based questions is most challenging due to the dependency on customer generated content. Previous works mostly focused on review aware answer prediction however, these approaches fail for new or unpopular products, having no (or only a few) reviews at hand. In this work, we propose a novel and complementary approach for predicting the answer for such questions, based on the answers for similar questions asked on similar products. We measure the contextual similarity between products based on the answers they provide for the same question. A mixture of expert framework is used to predict the answer by aggregating the answers from contextually similar products. Empirical results demonstrate that our model outperforms strong baselines on some segments of questions, namely those that have roughly ten or more similar resolved questions in the corpus. We additionally publish two large scale datasets used in this work, one is of similar product question pairs, and the second is of product question answer pairs.


'Etale Covers and Fundamental Groups of Schematic Finite Spaces. We introduce the category of finite 'etale covers of an arbitrary schematic finite space X and show that, equipped with an appropriate natural fiber functor, it is a Galois Category. This allows us to define the 'etale fundamental group of schematic spaces. If X is a finite model of a scheme S , we show that the resulting Galois theory on X coincides with the classical theory of finite 'etale covers on S and therefore we recover the classical 'etale fundamental group introduced by Grothendieck. In order to prove these results it is crucial to find a suitable geometric notion of connectedness for schematic finite spaces and also to study their geometric points. We achieve these goals by means of the strong cohomological constraints enjoyed by schematic finite spaces.


DLA Net Learning Dual Local Attention Features for Semantic Segmentation of Large Scale Building Facade Point Clouds. Semantic segmentation of building facade is significant in various applications, such as urban building reconstruction and damage assessment. As there is a lack of 3D point clouds datasets related to the fine grained building facade, we construct the first large scale building facade point clouds benchmark dataset for semantic segmentation. The existing methods of semantic segmentation cannot fully mine the local neighborhood information of point clouds. Addressing this problem, we propose a learnable attention module that learns Dual Local Attention features, called DLA in this paper. The proposed DLA module consists of two blocks, including the self attention block and attentive pooling block, which both embed an enhanced position encoding block. The DLA module could be easily embedded into various network architectures for point cloud segmentation, naturally resulting in a new 3D semantic segmentation network with an encoder decoder architecture, called DLA Net in this work. Extensive experimental results on our constructed building facade dataset demonstrate that the proposed DLA Net achieves better performance than the state of the art methods for semantic segmentation.


A discrete boundedness by entropy method for finite volume approximations of cross diffusion systems. An implicit Euler finite volume scheme for general cross diffusion systems with volume filling constraints is proposed and analyzed. The diffusion matrix may be nonsymmetric and not positive semidefinite, but the diffusion system is assumed to possess a formal gradient flow structure that yields L infty bounds on the continuous level. Examples include the Maxwell Stefan systems for gas mixtures, tumor growth models, and systems for the fabrication of thin film solar cells. The proposed numerical scheme preserves the structure of the continuous equations, namely the entropy dissipation inequality as well as the nonnegativity of the concentrations and the volume filling constraints. The discrete entropy structure is a consequence of a new vector valued discrete chain rule. The existence of discrete solutions, their positivity, and the convergence of the scheme is proved. The numerical scheme is implemented for a one dimensional Maxwell Stefan model and a two dimensional thin film solar cell system. It is illustrated that the convergence rate in space is of order two and the discrete relative entropy decays exponentially.


Context Matters A Theory of Semantic Discriminability for Perceptual Encoding Systems. People's associations between colors and concepts influence their ability to interpret the meanings of colors in information visualizations. Previous work has suggested such effects are limited to concepts that have strong, specific associations with colors. However, although a concept may not be strongly associated with any colors, its mapping can be disambiguated in the context of other concepts in an encoding system. We articulate this view in semantic discriminability theory, a general framework for understanding conditions determining when people can infer meaning from perceptual features. Semantic discriminability is the degree to which observers can infer a unique mapping between visual features and concepts. Semantic discriminability theory posits that the capacity for semantic discriminability for a set of concepts is constrained by the difference between the feature concept association distributions across the concepts in the set. We define formal properties of this theory and test its implications in two experiments. The results show that the capacity to produce semantically discriminable colors for sets of concepts was indeed constrained by the statistical distance between color concept association distributions (Experiment 1). Moreover, people could interpret meanings of colors in bar graphs insofar as the colors were semantically discriminable, even for concepts previously considered "non colorable" (Experiment 2). The results suggest that colors are more robust for visual communication than previously thought.


Out of Band Power Reduction in NC OFDM with Optimized Cancellation Carriers Selection. In this letter, we propose a computationally efficient method for joint selection of cancellation carriers (CCs) and calculation of their values minimizing the out of band (OOB) power in non contiguous (NC ) OFDM transmission. The proposed new CCs selection method achieves higher OOB power attenuation than algorithms known from literature as well as noticable reception performance improvement.


FlexMatch Boosting Semi Supervised Learning with Curriculum Pseudo Labeling. The recently proposed FixMatch achieved state of the art results on most semi supervised learning (SSL) benchmarks. However, like other modern SSL algorithms, FixMatch uses a pre defined constant threshold for all classes to select unlabeled data that contribute to the training, thus failing to consider different learning status and learning difficulties of different classes. To address this issue, we propose Curriculum Pseudo Labeling (CPL), a curriculum learning approach to leverage unlabeled data according to the model's learning status. The core of CPL is to flexibly adjust thresholds for different classes at each time step to let pass informative unlabeled data and their pseudo labels. CPL does not introduce additional parameters or computations (forward or backward propagation). We apply CPL to FixMatch and call our improved algorithm FlexMatch. FlexMatch achieves state of the art performance on a variety of SSL benchmarks, with especially strong performances when the labeled data are extremely limited or when the task is challenging. For example, FlexMatch achieves 13.96 and 18.96 error rate reduction over FixMatch on CIFAR 100 and STL 10 datasets respectively, when there are only 4 labels per class. CPL also significantly boosts the convergence speed, e.g., FlexMatch can use only 1 5 training time of FixMatch to achieve even better performance. Furthermore, we show that CPL can be easily adapted to other SSL algorithms and remarkably improve their performances. We open source our code at https github.com TorchSSL TorchSSL.


Pointwise space time estimates of two phase fluid model in dimension three. In this paper, we investigate the pointwise space time behavior of two phase fluid model derived by Choi cite Choi SIAM J. Math. Anal., 48(2016), pp. 3090 3122 , which is the compressible damped Euler equations coupled with compressible Naiver Stokes equations. Based on Green's function method together with frequency analysis and nonlinear coupling of different wave patterns, it shows that both of two densities and momentums obey the generalized Huygens' principle as the compressible Navier Stokes equations cite LW , however, it is different from the compressible damped Euler equations cite Wang2 . The main contributions include seeking suitable combinations to avoid the singularity from the Hodge decomposition in the low frequency part of the Green's function, overcoming the difficulty of the non conservation arising from the damped mechanism of the system, and developing the detailed description of the singularities in the high frequency part of the Green's function. Finally, as a byproduct, we extend L 2 estimate in cite Wugc SIAM J. Math. Anal., 52(2020), pp. 5748 5774 to L p estimate with p 1 .


Multimodal and Contrastive Learning for Click Fraud Detection. Advertising click fraud detection plays one of the vital roles in current E commerce websites as advertising is an essential component of its business model. It aims at, given a set of corresponding features, e.g., demographic information of users and statistical features of clicks, predicting whether a click is fraudulent or not in the community. Recent efforts attempted to incorporate attributed behavior sequence and heterogeneous network for extracting complex features of users and achieved significant effects on click fraud detection. In this paper, we propose a Multimodal and Contrastive learning network for Click Fraud detection (MCCF). Specifically, motivated by the observations on differences of demographic information, behavior sequences and media relationship between fraudsters and genuine users on E commerce platform, MCCF jointly utilizes wide and deep features, behavior sequence and heterogeneous network to distill click representations. Moreover, these three modules are integrated by contrastive learning and collaboratively contribute to the final predictions. With the real world datasets containing 2.54 million clicks on Alibaba platform, we investigate the effectiveness of MCCF. The experimental results show that the proposed approach is able to improve AUC by 7.2 and F1 score by 15.6 , compared with the state of the art methods.


Dense Relation Distillation with Context aware Aggregation for Few Shot Object Detection. Conventional deep learning based methods for object detection require a large amount of bounding box annotations for training, which is expensive to obtain such high quality annotated data. Few shot object detection, which learns to adapt to novel classes with only a few annotated examples, is very challenging since the fine grained feature of novel object can be easily overlooked with only a few data available. In this work, aiming to fully exploit features of annotated novel object and capture fine grained features of query object, we propose Dense Relation Distillation with Context aware Aggregation (DCNet) to tackle the few shot detection problem. Built on the meta learning based framework, Dense Relation Distillation module targets at fully exploiting support features, where support features and query feature are densely matched, covering all spatial locations in a feed forward fashion. The abundant usage of the guidance information endows model the capability to handle common challenges such as appearance changes and occlusions. Moreover, to better capture scale aware features, Context aware Aggregation module adaptively harnesses features from different scales for a more comprehensive feature representation. Extensive experiments illustrate that our proposed approach achieves state of the art results on PASCAL VOC and MS COCO datasets. Code will be made available at https github.com hzhupku DCNet.


Axiomatization of the degree of Fitzpatrick, Pejsachowicz and Rabier. In this paper we prove an analogue of the uniqueness theorems of F "uhrer and Amann and Weiss to cover the degree of Fredholm operators of index zero of Fitzpatrick, Pejsachowicz and Rabier, whose range of applicability is substantially wider than for the most classical degrees of Brouwer and Leray Schauder. A crucial step towards the axiomatization of the Fitzpatrick Pejsachowicz Rabier degree is provided by the generalized algebraic multiplicity of Esquinas and L ' o pez G ' o mez, chi , and the axiomatization theorem of Mora Corral. The latest result facilitates the axiomatization of the parity of Fitzpatrick and Pejsachowicz, sigma( cdot, a,b ) , which provides the key step for establishing the uniqueness of the degree for Fredholm maps.


Interpretable Machine Learning for Resource Allocation with Application to Ventilator Triage. Rationing of healthcare resources is a challenging decision that policy makers and providers may be forced to make during a pandemic, natural disaster, or mass casualty event. Well defined guidelines to triage scarce life saving resources must be designed to promote transparency, trust, and consistency. To facilitate buy in and use during high stress situations, these guidelines need to be interpretable and operational. We propose a novel data driven model to compute interpretable triage guidelines based on policies for Markov Decision Process that can be represented as simple sequences of decision trees ("tree policies"). In particular, we characterize the properties of optimal tree policies and present an algorithm based on dynamic programming recursions to compute good tree policies. We utilize this methodology to obtain simple, novel triage guidelines for ventilator allocations for COVID 19 patients, based on real patient data from Montefiore hospitals. We also compare the performance of our guidelines to the official New York State guidelines that were developed in 2015 (well before the COVID 19 pandemic). Our empirical study shows that the number of excess deaths associated with ventilator shortages could be reduced significantly using our policy. Our work highlights the limitations of the existing official triage guidelines, which need to be adapted specifically to COVID 19 before being successfully deployed.


Optimising the mitigation of epidemic spreading through targeted adoption of contact tracing apps. The ongoing COVID 19 pandemic is the first epidemic in human history in which digital contact tracing has been deployed at a global scale. Tracking and quarantining all the contacts of individuals who test positive to a virus can help slowing down an epidemic, but the impact of contact tracing is severely limited by the generally low adoption of contact tracing apps in the population. We derive here an analytical expression for the effectiveness of contact tracing app installation strategies in a SIR model on a given contact graph. We propose a decentralised heuristic to improve the effectiveness of contact tracing under fixed adoption rates, which targets a set of individuals to install contact tracing apps, and can be easily implemented. Simulations on a large number of real world contact networks confirm that this heuristic represents a feasible alternative to the current state of the art.


A Transformer based Model to Detect Phishing URLs. Phishing attacks are among emerging security issues that recently draws significant attention in the cyber security community. There are numerous existing approaches for phishing URL detection. However, malicious URL detection is still a research hotspot because attackers can bypass newly introduced detection mechanisms by changing their tactics. This paper will introduce a transformer based malicious URL detection model, which has significant accuracy and outperforms current detection methods. We conduct experiments and compare them with six existing classical detection models. Experiments demonstrate that our transformer based model is the best performing model from all perspectives among the seven models and achieves 97.3 of detection accuracy.


Low elements and small inversion sets are in bijection in rank 3 Coxeter groups. In this extended abstract we announce a proof that, in a Coxeter group of rank 3, low elements are in bijection with small inversion sets. This gives a partial confirmation of Conjecture 2 in Dyer, Hohlweg '16 . That same article provides the main ingredient the bipodality of the set of small roots is used to propagate information on the vertices of inversion polytopes.


Restorable Shortest Path Tiebreaking for Edge Faulty Graphs. The restoration lemma by Afek, Bremler Barr, Kaplan, Cohen, and Merritt Dist. Comp. '02 proves that, in an undirected unweighted graph, any replacement shortest path avoiding a failing edge can be expressed as the concatenation of two original shortest paths. However, the lemma is tiebreaking sensitive if one selects a particular canonical shortest path for each node pair, it is no longer guaranteed that one can build replacement paths by concatenating two selected shortest paths. They left as an open problem whether a method of shortest path tiebreaking with this desirable property is generally possible. We settle this question affirmatively with the first general construction of restorable tiebreaking schemes. We then show applications to various problems in fault tolerant network design. These include a faster algorithm for subset replacement paths, more efficient fault tolerant (exact) distance labeling schemes, fault tolerant subset distance preservers and 4 additive spanners with improved sparsity, and fast distributed algorithms that construct these objects. For example, an almost immediate corollary of our restorable tiebreaking scheme is the first nontrivial distributed construction of sparse fault tolerant distance preservers resilient to three faults.


No bounded geometry wandering domains for sufficiently regular automorphisms. A question whether sufficiently regular manifold automorphisms may have wandering domains with controlled geometry is answered in the negative for quasiconformal or smooth homeomorphisms of n tori, n ge2 , and mathcal C 1 diffeomorphisms of hyperbolic surfaces. Besides the bounded geometry of wandering domains, the assumptions are either analytic, e.g., minimal sets having measure zero or supporting invariant conformal structures, or geometric, such as uniform relative separation of wandering domains.


SPARK SPAcecraft Recognition leveraging Knowledge of Space Environment. This paper proposes the SPARK dataset as a new unique space object multi modal image dataset. Image based object recognition is an important component of Space Situational Awareness, especially for applications such as on orbit servicing, active debris removal, and satellite formation. However, the lack of sufficient annotated space data has limited research efforts in developing data driven spacecraft recognition approaches. The SPARK dataset has been generated under a realistic space simulation environment, with a large diversity in sensing conditions for different orbital scenarios. It provides about 150k images per modality, RGB and depth, and 11 classes for spacecrafts and debris. This dataset offers an opportunity to benchmark and further develop object recognition, classification and detection algorithms, as well as multi modal RGB Depth approaches under space sensing conditions. Preliminary experimental evaluation validates the relevance of the data, and highlights interesting challenging scenarios specific to the space environment.


A diophantine problem concerning third order matrices. In this paper we find a third order unimodular matrix, none of whose entries is 1 or 1 , such that when each entry of the matrix is replaced by its cube, the resulting matrix is also unimodular. Further, we find third order square integer matrices (a ij ) , none of the integers a ij being 1 or 1 , such that det (a ij ) k and det (a ij 3) k 3 , where k is a nonzero integer.


How to write a coequation. There is a large amount of literature on the topic of covarieties, coequations and coequational specifications, dating back to the early seventies. Nevertheless, coequations have not (yet) emerged as an everyday practical specification formalism for computer scientists. In this review paper, we argue that this is partly due to the multitude of syntaxes for writing down coequations, which seems to have led to some confusion about what coequations are and what they are for. By surveying the literature, we identify four types of syntaxes coequations as corelations, coequations as predicates, coequations as equations, and coequations as modal formulas. We present each of these in a tutorial fashion, relate them to each other, and discuss their respective uses.


A change of variable formula with applications to multi dimensional optimal stopping problems. We derive a change of variable formula for C 1 functions U mathbb R times mathbb R m to mathbb R whose second order spatial derivatives may explode and not be integrable in the neighbourhood of a surface b mathbb R times mathbb R m 1 to mathbb R that splits the state space into two sets mathcal C and mathcal D . The formula is tailored for applications in problems of optimal stopping where it is generally very hard to control the second derivatives of the value function near the optimal stopping boundary. Differently to other existing papers on similar topics we only require that the surface b be monotonic in each variable and we formally obtain the same expression as the classical It o's formula.


Customized Monte Carlo Tree Search for LLVM Polly's Composable Loop Optimization Transformations. Polly is the LLVM project's polyhedral loop nest optimizer. Recently, user directed loop transformation pragmas were proposed based on LLVM Clang and Polly. The search space exposed by the transformation pragmas is a tree, wherein each node represents a specific combination of loop transformations that can be applied to the code resulting from the parent node's loop transformations. We have developed a search algorithm based on Monte Carlo tree search (MCTS) to find the best combination of loop transformations. Our algorithm consists of two phases exploring loop transformations at different depths of the tree to identify promising regions in the tree search space and exploiting those regions by performing a local search. Moreover, a restart mechanism is used to avoid the MCTS getting trapped in a local solution. The best and worst solutions are transferred from the previous phases of the restarts to leverage the search history. We compare our approach with random, greedy, and breadth first search methods on PolyBench kernels and ECP proxy applications. Experimental results show that our MCTS algorithm finds pragma combinations with a speedup of 2.3x over Polly's heuristic optimizations on average.


Weakly J ideals of Commutative Rings. Let R be a commutative ring with non zero identity. In this paper, we introduce the concept of weakly J ideals as a new generalization of J ideals. We call a proper ideal I of a ring R a weakly J ideal if whenever a,b in R with 0 neq ab in I and a notin J(R) , then a in I . Many of the basic properties and characterizations of this concept are studied. We investigate weakly J ideals under various contexts of constructions such as direct products, localizations, homomorphic images. Moreover, a number of examples and results on weakly J ideals are discussed. Finally, the third section is devoted to the characterizations of these constructions in an amagamated ring along an ideal.


Normalisation and subformula property for a system of intuitionistic logic with general introduction and elimination rules. This paper studies a formalisation of intuitionistic logic by Negri and von Plato which has general introduction and elimination rules. The philosophical importance of the system is expounded. Definitions of maximal formula', segment' and maximal segment' suitable to the system are formulated and corresponding reduction procedures for maximal formulas and permutative reduction procedures for maximal segments given. Alternatives to the main method used are also considered. It is shown that deductions in the system convert into normal form and that deductions in normal form have the subformula property.


TrollsWithOpinion A Dataset for Predicting Domain specific Opinion Manipulation in Troll Memes. Research into the classification of Image with Text (IWT) troll memes has recently become popular. Since the online community utilizes the refuge of memes to express themselves, there is an abundance of data in the form of memes. These memes have the potential to demean, harras, or bully targeted individuals. Moreover, the targeted individual could fall prey to opinion manipulation. To comprehend the use of memes in opinion manipulation, we define three specific domains (product, political or others) which we classify into troll or not troll, with or without opinion manipulation. To enable this analysis, we enhanced an existing dataset by annotating the data with our defined classes, resulting in a dataset of 8,881 IWT or multimodal memes in the English language (TrollsWithOpinion dataset). We perform baseline experiments on the annotated dataset, and our result shows that existing state of the art techniques could only reach a weighted average F1 score of 0.37. This shows the need for a development of a specific technique to deal with multimodal troll memes.


Foresee then Evaluate Decomposing Value Estimation with Latent Future Prediction. Value function is the central notion of Reinforcement Learning (RL). Value estimation, especially with function approximation, can be challenging since it involves the stochasticity of environmental dynamics and reward signals that can be sparse and delayed in some cases. A typical model free RL algorithm usually estimates the values of a policy by Temporal Difference (TD) or Monte Carlo (MC) algorithms directly from rewards, without explicitly taking dynamics into consideration. In this paper, we propose Value Decomposition with Future Prediction (VDFP), providing an explicit two step understanding of the value estimation process 1) first foresee the latent future, 2) and then evaluate it. We analytically decompose the value function into a latent future dynamics part and a policy independent trajectory return part, inducing a way to model latent dynamics and returns separately in value estimation. Further, we derive a practical deep RL algorithm, consisting of a convolutional model to learn compact trajectory representation from past experiences, a conditional variational auto encoder to predict the latent future dynamics and a convex return model that evaluates trajectory representation. In experiments, we empirically demonstrate the effectiveness of our approach for both off policy and on policy RL in several OpenAI Gym continuous control tasks as well as a few challenging variants with delayed reward.


On Fano threefolds of degree 22 after Cheltsov and Shramov. It has been known that nonsingular Fano threefolds of Picard rank one with the anti canonical degree 22 admitting faithful actions of the multiplicative group form a one dimensional family. Cheltsov and Shramov showed that all but two of them admit K "ahler Einstein metrics. In this paper, we show that the remaining Fano threefolds also admit K "ahler Einstein metrics.


Enhancing Data driven Multiscale Topology Optimization with Generalized De homogenization. De homogenization is becoming an effective method to significantly expedite the design of high resolution multiscale structures, but existing methods have thus far been confined to simple static compliance minimization. There are two critical challenges to be addressed in accommodating general cases enabling the design of unit cell orientation and using free form microstructures. In this paper, we propose a data driven de homogenization method that allows effective design of the unit cell orientation angles and conformal mapping of spatially varying, complex microstructures. We devise a parameterized microstructure composed of rods in different directions to provide more diversity in stiffness while retaining geometrical simplicity. The microstructural geometry property relationship is then surrogated by a neural network to avoid costly homogenization. A Cartesian representation of the unit cell orientation is incorporated into homogenization based optimization to design the angles. Corresponding high resolution multiscale structures are obtained from the homogenization based designs through a conformal mapping constructed with sawtooth function fields. This allows us to assemble complex microstructures with an oriented and compatible tiling pattern, while preserving the local homogenized properties. To demonstrate our method with a specific application, we optimize the frequency response of structures under harmonic excitations within a given frequency range. It is the first time that a sawtooth function is applied in a de homogenization framework for complex design scenarios beyond static compliance minimization. The examples illustrate that multiscale structures can be generated with high efficiency and much better dynamic performance compared with the macroscale only optimization. Beyond frequency response design, our proposed framework can be applied to other general problems.


Avengers Ensemble! Improving Transferability of Authorship Obfuscation. Stylometric approaches have been shown to be quite effective for real world authorship attribution. To mitigate the privacy threat posed by authorship attribution, researchers have proposed automated authorship obfuscation approaches that aim to conceal the stylometric artefacts that give away the identity of an anonymous document's author. Recent work has focused on authorship obfuscation approaches that rely on black box access to an attribution classifier to evade attribution while preserving semantics. However, to be useful under a realistic threat model, it is important that these obfuscation approaches work well even when the adversary's attribution classifier is different from the one used internally by the obfuscator. Unfortunately, existing authorship obfuscation approaches do not transfer well to unseen attribution classifiers. In this paper, we propose an ensemble based approach for transferable authorship obfuscation. Our experiments show that if an obfuscator can evade an ensemble attribution classifier, which is based on multiple base attribution classifiers, it is more likely to transfer to different attribution classifiers. Our analysis shows that ensemble based authorship obfuscation achieves better transferability because it combines the knowledge from each of the base attribution classifiers by essentially averaging their decision boundaries.


JFB Jacobian Free Backpropagation for Implicit Networks. A promising trend in deep learning replaces traditional feedforward networks with implicit networks. Unlike traditional networks, implicit networks solve a fixed point equation to compute inferences. Solving for the fixed point varies in complexity, depending on provided data and an error tolerance. Importantly, implicit networks may be trained with fixed memory costs in stark contrast to feedforward networks, whose memory requirements scale linearly with depth. However, there is no free lunch backpropagation through implicit networks often requires solving a costly Jacobian based equation arising from the implicit function theorem. We propose Jacobian Free Backpropagation (JFB), a fixed memory approach that circumvents the need to solve Jacobian based equations. JFB makes implicit networks faster to train and significantly easier to implement, without sacrificing test accuracy. Our experiments show implicit networks trained with JFB are competitive with feedforward networks and prior implicit networks given the same number of parameters.


Clustering Algorithms to Analyze the Road Traffic Crashes. Selecting an appropriate clustering method as well as an optimal number of clusters in road accident data is at times confusing and difficult. This paper analyzes shortcomings of different existing techniques applied to cluster accident prone areas and recommends using Density Based Spatial Clustering of Applications with Noise (DBSCAN) and Ordering Points To Identify the Clustering Structure (OPTICS) to overcome them. Comparative performance analysis based on real life data on the recorded cases of road accidents in North Carolina also show more effectiveness and efficiency achieved by these algorithms.


Global gradient estimate for a divergence problem and its application to the homogenization of a magnetic suspension. This paper generalizes the results obtained by the authors in cite dangHomogenizationNondiluteSuspension2021 concerning the homogenization of a non dilute suspension of magnetic particles in a viscous flow. More specifically, in this paper, a restrictive assumption on the coefficients of the coupled equation, made in cite dangHomogenizationNondiluteSuspension2021 , that significantly narrowed the applicability of the homogenization results obtained, is relaxed and a new regularity of the solution of the fine scale problem is proven. In particular, we obtain a global L infty bound for the gradient of the solution of the scalar equation mathrm div left mathbf a left( x varepsilon right) nabla varphi varepsilon (x) right f(x) , uniform with respect to microstructure scale parameter varepsilon ll 1 in a small interval (0, varepsilon 0) , where the coefficient mathbf a is only emph piecewise H " o lder continuous. Thenceforth, this regularity is used in the derivation of the effective response of the given suspension discussed in cite dangHomogenizationNondiluteSuspension2021 .


A quadratic Reynolds stress development for the turbulent Kolmogorov flow. We study the three dimensional turbulent Kolmogorov flow, i.e. the Navier Stokes equations forced by a low single wave number sinusoidal force in a periodic domain, by means of direct numerical simulations. This classical model system is a realization of anisotropic and non homogeneous hydrodynamic turbulence. Boussinesq's eddy viscosity linear relation is checked and found to be approximately valid over half of the system volume. A more general nonlinear quadratic Reynolds stress development is proposed and its parameters estimated at varying the Taylor scale based Reynolds number in the flow up to the value 200. The case of a forcing with a different shape, here chosen Gaussian, is considered and the differences with the sinusoidal forcing are emphasized.


Entropy inequalities for random walks and permutations. We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block type dynamics for permutations. The inequality lies between the classical logarithmic Sobolev inequality and the modified logarithmic Sobolev inequality, roughly interpolating between the two as the size of the blocks grows. Our results suggest that the new inequality may have some advantages with respect to the latter well known inequalities when multi particle processes are considered. We prove a strong form of tensorization for independent particles interacting through synchronous updates. Moreover, for block dynamics on permutations we compute the optimal constants in all mean field settings, namely whenever the rate of update of a block depends only on the size of the block. Along the way we establish the independence of the spectral gap on the number of particles for these mean field processes. As an application of our entropy inequalities we prove a new subadditivity estimate for permutations, which implies a sharp upper bound on the permanent of arbitrary matrices with nonnegative entries, thus resolving a well known conjecture.


DIALKI Knowledge Identification in Conversational Systems through Dialogue Document Contextualization. Identifying relevant knowledge to be used in conversational systems that are grounded in long documents is critical to effective response generation. We introduce a knowledge identification model that leverages the document structure to provide dialogue contextualized passage encodings and better locate knowledge relevant to the conversation. An auxiliary loss captures the history of dialogue document connections. We demonstrate the effectiveness of our model on two document grounded conversational datasets and provide analyses showing generalization to unseen documents and long dialogue contexts.


Edge Featured Graph Attention Network. Lots of neural network architectures have been proposed to deal with learning tasks on graph structured data. However, most of these models concentrate on only node features during the learning process. The edge features, which usually play a similarly important role as the nodes, are often ignored or simplified by these models. In this paper, we present edge featured graph attention networks, namely EGATs, to extend the use of graph neural networks to those tasks learning on graphs with both node and edge features. These models can be regarded as extensions of graph attention networks (GATs). By reforming the model structure and the learning process, the new models can accept node and edge features as inputs, incorporate the edge information into feature representations, and iterate both node and edge features in a parallel but mutual way. The results demonstrate that our work is highly competitive against other node classification approaches, and can be well applied in edge featured graph learning tasks.


FLOSS ! GitHub A Case Study of Linux BSD Perceptions from Microsoft's Acquisition of GitHub. In 2018, the software industry giants Microsoft made a move into the Open Source world by completing the acquisition of mega Open Source platform, GitHub. This acquisition was not without controversy, as it is well known that the free software communities includes not only the ability to use software freely, but also the libre nature in Open Source Software. In this study, our aim is to explore these perceptions in FLOSS developers. We conducted a survey that covered traditional FLOSS source Linux, and BSD communities and received 246 developer responses. The results of the survey confirm that the free community did trigger some communities to move away from GitHub and raised discussions into free and open software on the GitHub platform. The study reminds us that although GitHub is influential and trendy, it does not representative all FLOSS communities.


Findings on Conversation Disentanglement. Conversation disentanglement, the task to identify separate threads in conversations, is an important pre processing step in multi party conversational NLP applications such as conversational question answering and conversation summarization. Framing it as a utterance to utterance classification problem i.e. given an utterance of interest (UOI), find which past utterance it replies to we explore a number of transformer based models and found that BERT in combination with handcrafted features remains a strong baseline. We then build a multi task learning model that jointly learns utterance to utterance and utterance to thread classification. Observing that the ground truth label (past utterance) is in the top candidates when our model makes an error, we experiment with using bipartite graphs as a post processing step to learn how to best match a set of UOIs to past utterances. Experiments on the Ubuntu IRC dataset show that this approach has the potential to outperform the conventional greedy approach of simply selecting the highest probability candidate for each UOI independently, indicating a promising future research direction.


On the computation of fundamental functions and Abelian differentials of the third kind. We consider the construction of the fundamental function and Abelian differentials of the third kind on a plane algebraic curve over the field of complex numbers that has no singular points. The algorithm for constructing differentials of the third kind is described in Weierstrass's Lectures. The article discusses its implementation in the Sage computer algebra system. The specificity of this algorithm, as well as the very concept of the differential of the third kind, implies the use of not only rational numbers, but also algebraic ones, even when the equation of the curve has integer coefficients. Sage has a built in algebraic number field tool that allows implementing Weierstrass's algorithm almost verbatim. The simplest example of an elliptic curve shows that it requires too many resources, going far beyond the capabilities of an office computer. Then the symmetrization of the method is proposed and implemented, which solves the problem and allows significant economy of resources. The algorithm for constructing a differential of the third kind is used to find the value of the fundamental function according to the duality principle. Examples explored in the Sage system are provided.


Where and When Space Time Attention for Audio Visual Explanations. Explaining the decision of a multi modal decision maker requires to determine the evidence from both modalities. Recent advances in XAI provide explanations for models trained on still images. However, when it comes to modeling multiple sensory modalities in a dynamic world, it remains underexplored how to demystify the mysterious dynamics of a complex multi modal model. In this work, we take a crucial step forward and explore learnable explanations for audio visual recognition. Specifically, we propose a novel space time attention network that uncovers the synergistic dynamics of audio and visual data over both space and time. Our model is capable of predicting the audio visual video events, while justifying its decision by localizing where the relevant visual cues appear, and when the predicted sounds occur in videos. We benchmark our model on three audio visual video event datasets, comparing extensively to multiple recent multi modal representation learners and intrinsic explanation models. Experimental results demonstrate the clear superior performance of our model over the existing methods on audio visual video event recognition. Moreover, we conduct an in depth study to analyze the explainability of our model based on robustness analysis via perturbation tests and pointing games using human annotations.


The art of defense letting networks fool the attacker. Some deep neural networks are invariant to some input transformations, such as Pointnet is permutation invariant to the input point cloud. In this paper, we demonstrated this property could be powerful in defense of gradient based attacks. Specifically, we apply random input transformation which is invariant to the networks we want to defend. Extensive experiments demonstrate that the proposed scheme defeats various gradient based attackers in the targeted attack setting, and breaking the attack accuracy into nearly zero. Our code is available at footnotesize url https github.com cuge1995 IT Defense .


Conical Classification For Computationally Efficient One Class Topic Determination. As the Internet grows in size, so does the amount of text based information that exists. For many application spaces it is paramount to isolate and identify texts that relate to a particular topic. While one class classification would be ideal for such analysis, there is a relative lack of research regarding efficient approaches with high predictive power. By noting that the range of documents we wish to identify can be represented as positive linear combinations of the Vector Space Model representing our text, we propose Conical classification, an approach that allows us to identify if a document is of a particular topic in a computationally efficient manner. We also propose Normal Exclusion, a modified version of Bi Normal Separation that makes it more suitable within the one class classification context. We show in our analysis that our approach not only has higher predictive power on our datasets, but is also faster to compute.


Self similar geometries within the inertial subrange of scales in boundary layer turbulence. It is widely known that the inertial subrange of turbulent scales yields a power law signature in ensemble statistics such as the energy spectrum and structure functions both in theory and from observations. Despite promising findings on the topic of fractal geometries in turbulence, there is no concrete image for the physical flow features corresponding to this statistical signature in the inertial subrange. The present study uses boundary layer turbulence measurements to evaluate the self similar properties of velocity isosurfaces and investigate their influence on statistics for the velocity signal. The fractal dimension of velocity isosurfaces, indicating statistical self similarity in the size of "wrinkles" along each isosurface, is shown to be constant only within the inertial subrange of scales. For the transition between the inertial subrange and production range, it is inferred that the largest wrinkles become increasingly confined by the overall size of large scale coherent velocity regions such as uniform momentum zones. The self similarity of isosurfaces yields power law trends in subsequent one dimensional statistics. For instance, the theoretical 2 3 power law exponent for the structure function can be recovered by considering the collective behavior of numerous isosurface level sets. The results suggest that the physical presence of inertial subrange eddies is manifested in the self similar wrinkles of isosurfaces.


Impact of the Sensing Spectrum on Signal Recovery in Generalized Linear Models. We consider a nonlinear inverse problem mathbf y f( mathbf Ax ) , where observations mathbf y in mathbb R m are the componentwise nonlinear transformation of mathbf Ax in mathbb R m , mathbf x in mathbb R n is the signal of interest and mathbf A is a known linear mapping. By properly specifying the nonlinear processing function, this model can be particularized to many signal processing problems, including compressed sensing and phase retrieval. Our main goal in this paper is to understand the impact of sensing matrices, or more specifically the spectrum of sensing matrices, on the difficulty of recovering mathbf x from mathbf y . Towards this goal, we study the performance of one of the most successful recovery methods, i.e. the expectation propagation algorithm (EP). We define a notion for the spikiness of the spectrum of mathbf A and show the importance of this measure in the performance of the EP. Whether the spikiness of the spectrum can hurt or help the recovery performance of EP depends on f . We define certain quantities based on the function f that enables us to describe the impact of the spikiness of the spectrum on EP recovery. Based on our framework, we are able to show that for instance, in phase retrieval problems, matrices with spikier spectrums are better for EP, while in 1 bit compressed sensing problems, less spiky (flatter) spectrums offer better recoveries. Our results unify and substantially generalize the existing results that compare sub Gaussian and orthogonal matrices, and provide a platform toward designing optimal sensing systems.


An Upper Bound of Composition Series. An upper bound of composition series of groups of finite order is obtained. The bound is the first ever nontrivial bound and so far best possible.


Is In Domain Data Really Needed? A Pilot Study on Cross Domain Calibration for Network Quantization. Post training quantization methods use a set of calibration data to compute quantization ranges for network parameters and activations. The calibration data usually comes from the training dataset which could be inaccessible due to sensitivity of the data. In this work, we want to study such a problem can we use out of domain data to calibrate the trained networks without knowledge of the original dataset? Specifically, we go beyond the domain of natural images to include drastically different domains such as X ray images, satellite images and ultrasound images. We find cross domain calibration leads to surprisingly stable performance of quantized models on 10 tasks in different image domains with 13 different calibration datasets. We also find that the performance of quantized models is correlated with the similarity of the Gram matrices between the source and calibration domains, which can be used as a criterion to choose calibration set for better performance. We believe our research opens the door to borrow cross domain knowledge for network quantization and compression.


Primitive Normal Values of Rational Functions over Finite Fields. In this paper, we consider rational functions f with some minor restrictions over the finite field mathbb F q n , where q p k for some prime p and positive integer k . We establish a sufficient condition for the existence of a pair ( alpha,f( alpha)) of primitive normal elements in mathbb F q n over mathbb F q . Moreover, for q 2 k and rational functions f with quadratic numerators and denominators, we explicitly find that there are at most 55 finite fields mathbb F q n in which such a pair ( alpha,f( alpha)) of primitive normal elements may not exist.


Mixed Hodge structures on character varieties of nilpotent groups. Let R be the connected component of the identity of the variety of representations of a finitely generated nilpotent group N into a connected reductive complex affine algebraic group G. We determine the mixed Hodge structure on the representation variety R and on the character variety R G. We obtain explicit formulae (both closed and recursive) for the mixed Hodge polynomial of these representation and character varieties.


Proof of a conjecture on a special class of matrices over commutative rings of characteristic 2. In this note, we prove the conjecture posed by Keller and Rosemarin at Eurocrypt 2021 on the nullity of a matrix polynomial of a block matrix with Hadamard type blocks over commutative rings of characteristic 2. Therefore, it confirms the conjectural optimal bound on the dimension of invariant subspace of the Starkad cipher using the HADES design strategy. We also give characterizations of the algebraic structure formed by Hadamard matrices over commutative rings.


The eigenvalue problem for the regional fractional Laplacian in the small order limit. In this note, we study the asymptotic behavior of eigenvalues and eigenfunctions of the regional fractional Laplacian ( Delta) s as s to 0 . Our analysis leads to a study of the regional logarithmic Laplacian, which arises as a formal derivative of regional fractional Laplacians at s 0 .


The Fermat Torricelli Problem in the Projective Plane. We pose and study the Fermat Torricelli problem for a triangle in the projective plane under the sine distance. Our main finding is that if every side of the triangle has length greater than sin 60 circ , then the Fermat Torricelli point is the vertex opposite the longest side. Our proof relies on a complete characterization of the equilateral case together with a deformation argument.


Calibratable Hetero NodeRank for measuring node influence. Node influence metrics have been applied to many applications, including ranking web pages on internet, or locations on spatial networks. PageRank is a popular and effective algorithm for estimating node influence. However, conventional PageRank method considers neither the heterogeneity of network structures nor additional network information, causing a major impedance to performance improvement and an underestimation of non hub nodes' importance. As these problems are only partially studied, existing solutions are still not satisfying. This paper addresses the problems by presenting a general PageRank based model framework, dubbed Hetero NodeRank, that accounts for heterogeneous network topology and incorporates node attribute information to capture both link and node based effects in measuring node influence. Moreover, the framework enables the calibration of the proposed model against empirical data, which transforms the original deductive approach into an inductive one that could be useful for hypothesis testing and causal effect analysis. As the original unsupervised task becomes a supervised one, optimization methods can be leveraged for model calibrations. Experiments on real data from the national city network of China demonstrated that the proposed model outperforms several widely used algorithms.


Ab Initio Particle based Object Manipulation. This paper presents Particle based Object Manipulation (Prompt), a new approach to robot manipulation of novel objects ab initio, without prior object models or pre training on a large object data set. The key element of Prompt is a particle based object representation, in which each particle represents a point in the object, the local geometric, physical, and other features of the point, and also its relation with other particles. Like the model based analytic approaches to manipulation, the particle representation enables the robot to reason about the object's geometry and dynamics in order to choose suitable manipulation actions. Like the data driven approaches, the particle representation is learned online in real time from visual sensor input, specifically, multi view RGB images. The particle representation thus connects visual perception with robot control. Prompt combines the benefits of both model based reasoning and data driven learning. We show empirically that Prompt successfully handles a variety of everyday objects, some of which are transparent. It handles various manipulation tasks, including grasping, pushing, etc,. Our experiments also show that Prompt outperforms a state of the art data driven grasping method on the daily objects, even though it does not use any offline training data.


Trellis BMA Coded Trace Reconstruction on IDS Channels for DNA Storage. Sequencing a DNA strand, as part of the read process in DNA storage, produces multiple noisy copies which can be combined to produce better estimates of the original strand this is called trace reconstruction. One can reduce the error rate further by introducing redundancy in the write sequence and this is called coded trace reconstruction. In this paper, we model the DNA storage channel as an insertion deletion substitution (IDS) channel and design both encoding schemes and low complexity decoding algorithms for coded trace reconstruction. We introduce Trellis BMA, a new reconstruction algorithm whose complexity is linear in the number of traces, and compare its performance to previous algorithms. Our results show that it reduces the error rate on both simulated and experimental data. The performance comparisons in this paper are based on a new dataset of traces that will be publicly released with the paper. Our hope is that this dataset will enable research progress by allowing objective comparisons between candidate algorithms.


Range GAN Range Constrained Generative Adversarial Network for Conditioned Design Synthesis. Typical engineering design tasks require the effort to modify designs iteratively until they meet certain constraints, i.e., performance or attribute requirements. Past work has proposed ways to solve the inverse design problem, where desired designs are directly generated from specified requirements, thus avoid the trial and error process. Among those approaches, the conditional deep generative model shows great potential since 1) it works for complex high dimensional designs and 2) it can generate multiple alternative designs given any condition. In this work, we propose a conditional deep generative model, Range GAN, to achieve automatic design synthesis subject to range constraints. The proposed model addresses the sparse conditioning issue in data driven inverse design problems by introducing a label aware self augmentation approach. We also propose a new uniformity loss to ensure generated designs evenly cover the given requirement range. Through a real world example of constrained 3D shape generation, we show that the label aware self augmentation leads to an average improvement of 14 on the constraint satisfaction for generated 3D shapes, and the uniformity loss leads to a 125 average increase on the uniformity of generated shapes' attributes. This work laid the foundation for data driven inverse design problems where we consider range constraints and there are sparse regions in the condition space.


Iwahori metaplectic duality. Let F be a nonarchimedean local field. It is shown in earlier work that both spherical Whittaker functions on the metaplectic n fold cover of mathbf GL r(F) and Iwahori Whittaker functions on mathbf GL r(F) may be represented as partition functions of solvable lattice models, and these representations give new interpretations of various facts about the representation theory. In this paper we present an unexpected relationship between these two theories and construct a family of lattice models related by Drinfeld twisting that specialize to models equivalent to the above two cases. Dual to the useful Demazure recurrence relations satisfied by Iwahori Whittaker functions, this leads us to new Demazure recurrence relations for spherical metaplectic Whittaker functions. Furthermore, in prior work it was shown that the row transfer matrices of the lattice models for spherical metaplectic Whittaker functions could be represented as "half vertex operators" operating on the q Fock space of Kashiwara, Miwa and Stern. In this paper the same is shown for all the members of the family of lattice models including the one representing Iwahori Whittaker functions.


Learning Calibrated Guidance for Object Detection in Aerial Images. Object detection is one of the most fundamental yet challenging research topics in the domain of computer vision. Recently, the study on this topic in aerial images has made tremendous progress. However, complex background and worse imaging quality are obvious problems in aerial object detection. Most state of the art approaches tend to develop elaborate attention mechanisms for the space time feature calibrations with arduous computational complexity, while surprisingly ignoring the importance of feature calibrations in channel wise. In this work, we propose a simple yet effective Calibrated Guidance (CG) scheme to enhance channel communications in a feature transformer fashion, which can adaptively determine the calibration weights for each channel based on the global feature affinity correlations. Specifically, for a given set of feature maps, CG first computes the feature similarity between each channel and the remaining channels as the intermediary calibration guidance. Then, re representing each channel by aggregating all the channels weighted together via the guidance operation. Our CG is a general module that can be plugged into any deep neural networks, which is named as CG Net. To demonstrate its effectiveness and efficiency, extensive experiments are carried out on both oriented object detection task and horizontal object detection task in aerial images. Experimental results on two challenging benchmarks (DOTA and HRSC2016) demonstrate that our CG Net can achieve the new state of the art performance in accuracy with a fair computational overhead. The source code has been open sourced at https github.com WeiZongqi CG Net


Almost every matroid has an M(K 4) or a mathcal W 3 minor. We show that almost every matroid contains the rank 3 whirl mathcal W 3 or the complete graphic matroid M(K 4) as a minor.


Topic Scaling A Joint Document Scaling Topic Model Approach To Learn Time Specific Topics. This paper proposes a new methodology to study sequential corpora by implementing a two stage algorithm that learns time based topics with respect to a scale of document positions and introduces the concept of Topic Scaling which ranks learned topics within the same document scale. The first stage ranks documents using Wordfish, a Poisson based document scaling method, to estimate document positions that serve, in the second stage, as a dependent variable to learn relevant topics via a supervised Latent Dirichlet Allocation. This novelty brings two innovations in text mining as it explains document positions, whose scale is a latent variable, and ranks the inferred topics on the document scale to match their occurrences within the corpus and track their evolution. Tested on the U.S. State Of The Union two party addresses, this inductive approach reveals that each party dominates one end of the learned scale with interchangeable transitions that follow the parties' term of office. Besides a demonstrated high accuracy in predicting in sample documents' positions from topic scores, this method reveals further hidden topics that differentiate similar documents by increasing the number of learned topics to unfold potential nested hierarchical topic structures. Compared to other popular topic models, Topic Scaling learns topics with respect to document similarities without specifying a time frequency to learn topic evolution, thus capturing broader topic patterns than dynamic topic models and yielding more interpretable outputs than a plain latent Dirichlet allocation.


On the quadratic random matching problem in two dimensional domains. We investigate the average minimum cost of a bipartite matching, with respect to the squared Euclidean distance, between two samples of n i.i.d. random points on a bounded Lipschitz domain in the Euclidean plane, whose common law is absolutely continuous with strictly positive H "o lder continuous density. We confirm in particular the validity of a conjecture by D. Benedetto and E. Caglioti stating that the asymptotic cost as n grows is given by the logarithm of n multiplied by an explicit constant times the volume of the domain. Our proof relies on a reduction to the optimal transport problem between the associated empirical measures and a Whitney type decomposition of the domain, together with suitable upper and lower bounds for local and global contributions, both ultimately based on PDE tools. We further show how to extend our results to more general settings, including Riemannian manifolds, and also give an application to the asymptotic cost of the random quadratic bipartite travelling salesperson problem.


MapFusion A General Framework for 3D Object Detection with HDMaps. 3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles, however, have not been well exploited for boosting object detection tasks. In this paper, we propose a simple but effective framework MapFusion to integrate the map information into modern 3D object detector pipelines. In particular, we design a FeatureAgg module for HD Map feature extraction and fusion, and a MapSeg module as an auxiliary segmentation head for the detection backbone. Our proposed MapFusion is detector independent and can be easily integrated into different detectors. The experimental results of three different baselines on large public autonomous driving dataset demonstrate the superiority of the proposed framework. By fusing the map information, we can achieve 1.27 to 2.79 points improvements for mean Average Precision (mAP) on three strong 3d object detection baselines.


Neutron Response of the EJ 254 Boron Loaded Plastic Scintillator. Organic scintillators doped with capture agents provide a detectable signal for neutrons over a broad energy range. This work characterizes the fast and slow neutron response of EJ 254, an organic plastic scintillator with 5 natural boron loading by weight. For fast neutrons, the primary mechanism for light generation in organic scintillators is n p elastic scattering. To study the fast neutron response, the proton light yield of EJ 254 was measured at the 88 Inch Cyclotron at Lawrence Berkeley National Laboratory. Using a broad spectrum neutron source and a double time of flight technique, the EJ 254 proton light yield was obtained over the energy range of approximately 270 keV to 4.5 MeV and determined to be in agreement with other plastic scintillators comprised of the same polymer base. To isolate the slow neutron response, an AmBe source with polyethylene moderator was made incident on the EJ 254 scintillator surrounded by an array of EJ 309 observation detectors. Events in the EJ 254 target coincident with the signature 477.6 keV gamma ray (resulting from deexcitation of the residual 7 Li nucleus following boron neutron capture) were identified. Pulse shape discrimination was used to evaluate the temporal differences in the response of EJ 254 scintillation signals arising from gamma ray and fast slow neutron interactions. Clear separation between gamma ray and fast neutrons signals was not achieved and the neutron capture feature was observed to overlap both the gamma ray and fast neutron bands. Taking into account the electron light nonproportionality, the neutron capture light yield in EJ 254 was determined to be 89.4 pm 1.1 keVee.


Predicting Process Name from Network Data. The ability to identify applications based on the network data they generate could be a valuable tool for cyber defense. We report on a machine learning technique capable of using netflow like features to predict the application that generated the traffic. In our experiments, we used ground truth labels obtained from host based sensors deployed in a large enterprise environment we applied random forests and multilayer perceptrons to the tasks of browser vs. non browser identification, browser fingerprinting, and process name prediction. For each of these tasks, we demonstrate how machine learning models can achieve high classification accuracy using only netflow like features as the basis for classification.